-- Logs begin at Fri 2022-05-27 14:22:51 UTC, end at Fri 2022-05-27 15:34:06 UTC. -- May 27 15:05:29.064509 dv-cinder-842542-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 27 15:05:29.073123 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 27 15:05:29.075272 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 15:05:29 2022] *** May 27 15:05:29.075272 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 15:05:29.075272 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 15:05:29.075272 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: nodename: dv-cinder-842542-2-iscsi May 27 15:05:29.075272 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: machine: x86_64 May 27 15:05:29.075272 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: clock source: unix May 27 15:05:29.075272 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: pcre jit disabled May 27 15:05:29.075272 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: detected number of CPU cores: 4 May 27 15:05:29.075272 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: current working directory: / May 27 15:05:29.075272 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: detected binary path: /usr/bin/uwsgi-core May 27 15:05:29.075272 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: your processes number limit is 47680 May 27 15:05:29.075272 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: your memory page size is 4096 bytes May 27 15:05:29.075272 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: detected max file descriptor number: 2048 May 27 15:05:29.075272 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: lock engine: pthread robust mutexes May 27 15:05:29.076244 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: thunder lock: enabled May 27 15:05:29.076244 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 27 15:05:29.076244 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 15:05:29.121674 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: Python main interpreter initialized at 0x55ad0c0c69c0 May 27 15:05:29.121674 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: python threads support enabled May 27 15:05:29.121674 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: your server socket listen backlog is limited to 100 connections May 27 15:05:29.121674 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: your mercy for graceful operations on workers is 90 seconds May 27 15:05:29.122030 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: mapped 403077 bytes (393 KB) for 2 cores May 27 15:05:29.122108 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: *** Operational MODE: preforking *** May 27 15:05:29.122358 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: *** uWSGI is running in multiple interpreter mode *** May 27 15:05:29.122358 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: spawned uWSGI master process (pid: 103303) May 27 15:05:29.122553 dv-cinder-842542-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 27 15:05:29.123915 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: spawned uWSGI worker 1 (pid: 103304, cores: 1) May 27 15:05:29.123915 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: spawned uWSGI worker 2 (pid: 103305, cores: 1) May 27 15:05:29.123915 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 15:05:30.291491 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 15:05:30.292110 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 15:05:31.017564 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 15:05:31.017564 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: from cryptography.utils import int_from_bytes May 27 15:05:31.017907 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 15:05:31.017907 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: from cryptography.utils import int_from_bytes May 27 15:05:31.027052 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 15:05:31.027052 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: from cryptography.utils import int_from_bytes May 27 15:05:31.027385 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 15:05:31.027385 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: from cryptography.utils import int_from_bytes May 27 15:05:33.685511 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 15:05:33.686084 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 15:05:33.686274 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 15:05:33.686513 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 15:05:33.686887 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 15:05:33.686996 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 15:05:33.687079 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 15:05:33.687276 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.687372 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 15:05:33.687605 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.687706 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 15:05:33.687920 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 15:05:33.688020 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.688239 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.688327 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.688570 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.688665 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.688879 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.688966 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.689198 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.689292 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.689519 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.689611 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.689850 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.689945 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.690109 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.690209 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.690427 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.690512 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.690752 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842542-2-iscsi {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.690879 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.691084 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.691185 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.691390 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.691476 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.691702 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.691788 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842542-2-iscsi {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.692019 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.692186 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.692323 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.692410 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.692635 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.692727 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.692947 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.693082 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.693256 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.693436 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.693590 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.693887 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.694063 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.694214 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.694388 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.694647 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.694794 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.695002 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.695134 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.695264 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.695379 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.695500 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.695750 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.696416 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.696637 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.696813 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.696952 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.697079 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.697258 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.697396 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.697651 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.697779 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842542-2-iscsi {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.697968 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.698108 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.698281 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.698408 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.698596 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.698735 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842542-2-iscsi {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.699010 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.699139 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.699330 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.699458 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.699659 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.699796 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.699948 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.700082 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.700271 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.700408 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.700582 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.700727 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.700922 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.701065 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.701200 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.701327 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.701520 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.701648 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.701838 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.701972 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.702140 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.702270 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.702446 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.702574 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.702757 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.702936 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.703097 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.703223 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.703396 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.703550 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.703707 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.703843 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.703969 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.704091 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.704254 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.704388 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.704572 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.704709 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.704892 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.705029 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.705201 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.705327 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.705464 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.705589 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.705711 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.705841 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.705993 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.706134 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.706312 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.706454 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.706619 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.706755 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.706948 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.707087 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.707256 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.707384 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.707561 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.707696 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.707864 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.708001 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.708167 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.708303 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.708471 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.708607 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.708775 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.708913 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.709083 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.709208 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.709394 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.709530 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.709704 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.709833 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.710008 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.710134 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.710327 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.710456 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.710652 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.710789 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.711026 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.711174 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.711315 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.711467 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.711653 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.711784 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.711981 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.712107 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.712295 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.712423 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.712642 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.712779 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.712966 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.713106 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.713279 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.713417 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.713594 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.713720 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.713907 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.714042 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.714472 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.714613 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.714785 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.714952 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.715116 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.715254 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.715386 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.715520 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.715646 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.715776 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.715944 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.716072 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.716262 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.716402 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.716568 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.716696 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.716873 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.717010 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.717178 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.717307 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.717479 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.717606 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.717785 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.717919 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.718092 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.718231 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.718395 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.718527 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.718698 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.718834 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.719029 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.719159 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.719334 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.719461 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.719640 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.719768 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.719942 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.720077 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.720243 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.720371 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.720551 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.720678 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.720862 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.721007 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.721200 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.721327 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.721451 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.721582 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.721737 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.721864 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.722040 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.722169 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.722359 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.722498 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.722664 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.722802 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.723030 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.723167 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.723303 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.723427 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.723587 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.723716 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.723891 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.724027 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.724207 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.724411 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.724539 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.724662 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.724793 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.724917 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.725102 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.725241 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.725401 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.725528 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.725710 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.725837 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.726024 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.726161 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.726327 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.726455 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.726627 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.726752 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.727000 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.727146 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.727312 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.727577 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.727704 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.727828 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.727960 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.728085 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.728216 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.728342 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.728513 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.728642 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.728823 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.728952 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.729128 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.729256 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.729434 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.729563 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.729739 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.729869 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.730062 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.730191 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.730385 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.730513 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.730699 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.730836 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.731027 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.731151 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.731357 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.731484 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.731626 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:05:33.731755 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.731970 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.732110 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.732310 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.732448 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.732648 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.732777 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.732967 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.733107 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.733284 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.733429 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.733602 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.733728 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.733935 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.734061 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.734249 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.734377 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.734560 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.734687 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.734890 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.735020 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.735214 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.735337 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.735532 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.735668 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.735850 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.735980 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.736165 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.736305 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.736482 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.736617 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.736800 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.736929 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.737108 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.737238 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.737425 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.737553 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.737751 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.737877 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.738066 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.738203 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.738375 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.738510 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.738710 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.738836 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.739063 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.739194 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.739376 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.739509 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.739704 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.739831 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.740026 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.740156 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.740338 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.740465 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.740650 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.740791 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.740960 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.741089 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.741282 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.741487 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.741615 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.741747 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.741883 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.742008 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.742210 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.742338 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.743094 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.743422 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.743422 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.743675 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.743800 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.743923 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.744046 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.744177 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.744360 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.744488 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.744676 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.744804 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.744994 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.745135 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.745312 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.745438 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.745624 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.745753 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.745941 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.746077 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.746251 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.746388 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.746561 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.746689 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.746888 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.747033 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.747198 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.747326 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.747505 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.747632 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.747829 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.747956 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.748108 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.748237 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.748411 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.748548 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.748719 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.748848 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.749033 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.749162 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.749339 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.749473 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.749664 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.749792 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.749969 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.750096 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.750278 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.750414 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.750587 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.750717 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.750921 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.751052 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.751229 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.751370 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.751544 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.751667 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.751855 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.751956 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.752160 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.752270 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.752474 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.752571 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.752782 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.752878 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.753087 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.753185 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.753408 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.753505 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.753715 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.753874 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.754016 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.754154 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.754324 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.754458 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.754632 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.754776 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.754970 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.755064 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.755263 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.755359 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.755575 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.755841 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.755943 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.756173 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.756261 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.756487 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.756574 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.756799 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.756887 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.757116 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.757210 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.757433 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.757520 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.757743 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.757837 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.758066 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.758153 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.759309 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.759415 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.759664 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.759754 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.760232 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.760320 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.760808 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.760895 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.761232 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.761320 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.761553 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.761954 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.762095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.762374 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.762504 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.762701 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.762829 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.763056 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.763211 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.763541 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.763766 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.764004 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.764329 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.764463 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.764728 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.764909 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.765048 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.765513 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.765650 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.766119 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.766254 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.766521 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.766673 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.766873 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.767120 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.767340 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.767482 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.767764 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.768013 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.768141 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.768443 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.768571 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.768801 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.768931 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.769152 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.769280 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.769484 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.769613 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.769819 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.769949 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.770142 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.770271 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.770468 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.770596 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.770788 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.770933 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.771139 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.771269 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.771462 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.771602 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.771786 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.771918 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.772115 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.772217 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.772434 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.772542 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.772760 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.772857 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.773076 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.773181 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.773411 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.773518 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.773732 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.773898 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.774189 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.774292 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.774508 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.774614 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.774838 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.774958 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.775209 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.775296 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.775556 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.775727 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.775888 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.776062 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.776316 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.776403 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.776646 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.776735 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.776974 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.777061 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.777298 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.777385 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.777621 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.777717 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.777943 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.778032 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.778262 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.778362 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.778591 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.778689 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.778931 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.779032 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.779260 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.779346 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.779576 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.779671 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.779909 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.780001 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.780225 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.780319 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.780552 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.780639 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.780861 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.780948 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.781183 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.781346 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.781514 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.781601 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.781851 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.781936 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.782168 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.782274 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.782485 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.782581 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.782812 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.782925 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.783172 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.783268 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.783491 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.783585 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.783806 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.783892 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.784119 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.784207 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.784430 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.784523 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.784747 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.784843 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.785065 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.785160 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.785380 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.785468 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.785695 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.785788 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.786007 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.786094 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.786324 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.786428 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.786638 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.786727 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.786971 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.787063 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.787284 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.787372 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.787600 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.787697 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.787930 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.788017 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.788243 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.788330 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.788570 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.788677 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.788897 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.788983 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.789207 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.789293 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.789565 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.789672 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.789892 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.789980 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.790207 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.790295 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.790518 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.790613 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.790826 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.790928 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.791156 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.791242 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.791508 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.791606 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.791821 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.791907 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.792134 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.792222 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.792460 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.792566 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.792785 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.792887 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.793099 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.793186 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.793418 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.793506 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.793733 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.793819 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.794043 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.794128 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.794370 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.794458 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.794688 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.794774 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.795031 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.795119 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.795345 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.795432 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.795659 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.795746 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.795974 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.796069 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.796287 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.796380 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.796618 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.796706 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.796927 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.797027 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.797242 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.797335 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.797553 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.797639 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.797865 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.797958 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.798176 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.798263 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.798498 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.798583 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.799097 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.799200 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.799434 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.799530 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.799752 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.799839 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.800075 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.800162 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.800395 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.800488 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.800718 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.800803 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.801051 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.801138 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.801381 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.801475 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.801726 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.801821 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.802036 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.802135 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.802351 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.802451 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.802663 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.802749 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.803007 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.803100 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.803330 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.803419 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.803642 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.803730 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.803957 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.804045 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.804271 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.804365 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.804591 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.804685 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.804902 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.805489 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.805756 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.806063 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.806187 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.806373 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.806511 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.806695 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.806890 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.807032 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.807169 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.807349 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.807487 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.807661 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.807808 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.807991 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.808123 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.808311 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.808456 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.808620 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.808774 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.808929 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.809088 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.809239 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.809400 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.809587 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.809711 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.809896 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.810064 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.810241 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.810380 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.810576 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.810727 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.810946 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.811091 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.811260 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.811444 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.811570 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.811760 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.811900 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.812074 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.812209 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.812410 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.812522 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.812729 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.812815 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.813042 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.813128 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.813354 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.813442 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.813671 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.813763 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.813988 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.814087 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.814299 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.814432 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.814618 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.814704 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.814961 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.815064 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.815281 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.815376 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.815601 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.815688 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.815914 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.816008 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.816229 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.816314 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.816542 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.816628 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.816853 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.816951 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.817163 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.817257 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.817473 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.817558 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.817785 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.817873 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.818095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.818188 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.818409 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.818495 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.818716 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.818804 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.819059 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.819159 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.819367 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.819452 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.819678 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.819767 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.819988 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.820073 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.820352 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.820503 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.820598 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.820725 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.821578 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.821667 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.821916 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.822048 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.822235 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.822367 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.822548 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.822709 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.822914 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.823064 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.823197 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.823380 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.823509 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.823695 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.823819 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.824015 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.824134 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.824329 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.824461 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.824640 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.824786 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.824960 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.825096 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.825292 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.825411 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.825618 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.825713 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.825932 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.826019 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.826250 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.826387 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.826564 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.826661 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.826898 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.826989 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.827215 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.827313 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.827533 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.827629 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.827839 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.827925 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.828149 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.828235 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.828463 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.828558 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.828776 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.828869 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.829083 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.829177 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.829393 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.829488 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.829700 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.829788 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.830016 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.830110 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.830329 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.830423 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.830641 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.830727 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.831016 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.831114 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.831328 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.831416 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.831648 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.831740 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.831964 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.832052 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.832282 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.832370 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.832600 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.832686 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.832911 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.832997 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.833229 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.833316 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.833543 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.833628 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.833853 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.833946 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.834159 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.834252 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.834468 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.834555 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.834785 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.834915 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.835123 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.835217 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.835432 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.835518 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.835757 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.835855 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.836073 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.836159 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.836488 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.836669 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.836802 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.837009 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.837106 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.837343 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.837456 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.837677 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.837773 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.837989 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.838075 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.838306 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.838399 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.838625 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.838725 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.838964 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.839055 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.839545 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.839631 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.839861 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.839958 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.840173 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.840259 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.840485 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.840623 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.840798 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.840999 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.841112 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.841339 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.841434 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.841659 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.841755 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.841974 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.842061 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.842293 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.842391 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.842611 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.842706 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.842954 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.843056 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.843269 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.843362 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.843578 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.843674 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.843905 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.844012 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.844225 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.844311 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.844539 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.844634 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.844858 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.844945 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.845170 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.845254 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.845528 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.845614 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.845847 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.845934 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.846165 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.846252 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.846473 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.846607 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.846832 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.846992 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.847172 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.847266 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.847497 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.847584 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.847820 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.847914 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.848128 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.848214 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.848445 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.848553 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.848758 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.848871 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.849088 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.849184 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.849399 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.849486 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.849709 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.849795 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.850019 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.850113 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.850348 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.850435 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.850656 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.850742 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.851010 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.851439 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.851756 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.851970 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.852408 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.852733 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.853069 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.853165 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.853387 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.853577 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.853725 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.853900 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.854157 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.854253 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.854478 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.854565 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.854793 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.854893 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.855204 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.855338 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.855520 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.855609 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.855842 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.855930 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.856158 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.856247 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.856491 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.856589 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.856823 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.857084 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.857170 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.857405 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.857501 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.857730 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.857817 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.858049 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.858143 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.858375 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.858474 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.858696 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.858791 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.859038 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.859127 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.859363 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.859453 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.859677 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.859764 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.860010 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.860105 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.860344 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.860432 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.860667 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.860756 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.860996 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.861091 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.861303 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.861422 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.861617 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.861755 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.861926 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.862074 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.862236 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.862401 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.862563 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.862737 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.862891 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.863079 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.863213 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.863396 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.863527 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.863713 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.863841 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.864025 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.864153 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.864338 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.864462 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.864789 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.864926 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.865098 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.865242 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.865427 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.865560 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.865745 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.865878 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.866072 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.866194 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.866398 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.866492 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.866712 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.866892 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.867058 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.867146 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.867373 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.867460 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.868234 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.868337 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.868549 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.868637 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.868860 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.868946 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.869303 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.869413 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.869528 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.869618 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.869855 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.869942 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.870169 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.870264 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.870482 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.870573 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.870795 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.870897 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.871133 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.871222 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.871486 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.871650 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.871800 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.871888 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.872125 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.872214 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.872457 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.872544 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.872769 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.872870 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.873080 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.873170 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.873395 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.873482 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.873703 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.873791 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.874012 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.874102 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.874323 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.874411 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.874638 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.874733 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.874977 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.875070 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.875287 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.875376 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.875595 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.875696 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.875915 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.876008 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.876221 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.876308 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.876529 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.876627 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.876843 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.876945 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.877149 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.877236 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.877458 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.877554 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.877763 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.877849 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.878089 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.878175 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.878402 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.878494 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.878732 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.878821 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.879074 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.879175 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.879385 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.879476 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.879696 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.879784 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.880006 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.880100 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.880332 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.880421 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.880651 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.880738 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.880970 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.881065 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.881290 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.881386 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.881609 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.881699 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.881930 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.882030 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.882244 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.882337 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.882561 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.882648 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.882899 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.883003 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.883865 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.884073 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.884185 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.884272 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.884512 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.884610 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.884898 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.885037 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.885225 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.885374 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.885550 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.885697 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.885869 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.886017 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.886195 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.886336 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.886518 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.886655 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.886857 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.886984 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.887301 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.887416 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.887617 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.887753 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.887932 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.888079 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.888248 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.888401 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.888582 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.888722 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.888910 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.889044 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.889249 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.889366 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.889590 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.889685 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.889914 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.890003 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.890235 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.890336 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.890554 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.890641 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.890894 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.890986 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.891260 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.891401 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.891580 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.891694 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.891893 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.892016 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.892215 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.892307 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.892536 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.892625 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.892855 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.892941 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.893170 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.893258 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.893485 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.893571 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.893803 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.893903 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.894119 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.894207 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.894435 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.894524 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.894750 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.894916 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.895092 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.895191 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.895409 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.895502 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.895727 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.895823 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.896048 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.896145 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.896369 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.896457 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.896686 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.896774 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.896998 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.897129 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.897316 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.897410 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.897635 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.897844 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.897966 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.898166 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.898308 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.898506 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.898633 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.898928 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.899073 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.899271 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.899396 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.899682 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.899772 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.900010 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.900240 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.900328 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.900566 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.900668 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.900910 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.900997 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.901244 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.901332 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.901561 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.901658 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.901874 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.901961 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.902201 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.902298 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.902518 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.902615 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.902827 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.902976 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.903174 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.903262 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.903492 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.903589 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.903808 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.904035 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.904129 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.904394 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.904490 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.904719 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.904806 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.905043 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.905128 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.905372 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.905467 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.905692 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.905817 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.906002 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.906238 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.906334 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.906601 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.906689 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.906953 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.907044 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.907276 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.907380 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.907593 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.907682 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.907906 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.907993 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.908217 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.908312 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.908532 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.908636 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.908847 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.908935 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.909161 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.909259 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.909474 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.909562 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.909781 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.909875 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.910092 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.910262 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.910406 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.910497 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.910713 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.910802 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.911049 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.911140 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.911380 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.911473 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.911675 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.911771 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.911986 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.912083 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.912294 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.912383 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.912603 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.912690 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.912918 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.913007 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.913229 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.913316 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.913541 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.913631 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.913849 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.913938 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.914165 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.914252 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.915009 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.915121 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.915324 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.915411 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.915645 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.915733 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.915960 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.916055 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.916278 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.916366 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.916592 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.916680 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.916909 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.917004 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.917222 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.917310 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.917538 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.917625 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.917867 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.917961 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.918182 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.918269 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.918520 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.918605 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.918836 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.918993 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.919184 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.919406 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.919504 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.919746 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.919843 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.920074 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.920162 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.920416 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.920512 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.920755 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.920855 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.921069 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.921158 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.921397 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.921613 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.921736 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.921955 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.922052 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.922284 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.922377 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.922621 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.922808 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.922959 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.923049 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.923275 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.923364 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.923591 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.923688 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.923903 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.923990 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.924216 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.924302 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.924529 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.924626 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.924843 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.924929 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.925151 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.925237 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.925465 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.925602 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.925778 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.925864 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.926087 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.926187 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.926400 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.926493 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.926715 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.926803 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.927057 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.927157 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.927374 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.927463 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.927690 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.927778 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.928006 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.928107 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.928320 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.928406 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.928635 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.928723 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.928950 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.929046 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.929270 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.929359 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.929589 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.929682 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.929913 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.930080 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.930784 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.930894 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.931130 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.931219 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.931450 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.931565 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.931767 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.931885 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.932083 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.932212 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.932405 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.932538 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.932741 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.932853 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.933065 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.933181 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.933377 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.933509 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.933806 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.933893 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.934126 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.934222 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.934439 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.934526 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.934766 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.934886 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.935111 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.935212 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.935443 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.935574 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.935772 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.935870 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.936084 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.936183 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.936394 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.936490 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.936703 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.936790 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.937016 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.937113 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.937340 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.937429 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.937655 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.937751 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.937962 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.938052 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.938269 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.938357 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.938581 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.938675 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.938908 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.939000 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.939224 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.939313 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.939533 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.939620 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.939841 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.939972 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.940149 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.940235 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.940452 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.940615 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.940759 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.940847 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.941067 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.941151 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.941371 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.941467 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.941680 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.941765 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.941982 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.942068 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.942294 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.942389 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.942601 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.942687 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.942933 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.943023 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.943242 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.943351 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.943553 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.943648 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.943861 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.943952 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.944193 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.944281 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.944511 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.944617 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.944820 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.944907 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.945131 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.945220 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.945440 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.945535 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.945781 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.945890 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.946091 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.946249 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.946422 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.946513 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.946746 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.946833 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.947089 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.947180 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.947403 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.947500 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.947721 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.947817 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.948045 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.948133 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.948358 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.948444 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.948672 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.948771 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.948988 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.949076 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.949307 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.949395 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.949620 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.949716 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.949953 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.950079 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.950267 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.950354 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.950583 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.950683 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.950924 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.951028 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.951244 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.951339 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.951561 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.951649 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.951877 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.951964 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.952192 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.952280 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.952531 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.952620 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.952842 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.952928 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.953153 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.953248 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.953475 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.953564 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.953789 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.953929 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.954105 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.954204 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.954421 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.954507 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.954738 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.954825 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.955092 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.955195 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.955411 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.955499 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.955723 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.955809 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.956038 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.956143 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.956354 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.956442 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.956676 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.956763 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.956996 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.957092 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.957327 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.957428 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.957672 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.957919 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.958014 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.958244 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.958333 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.958580 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.958674 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.958829 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 15:05:33.958964 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.959286 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.959606 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.959963 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.960302 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.960626 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.960947 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.961313 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:05:33.961638 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 15:05:34.018554 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO dbcounter [None req-5ae77594-efc1-46b4-9a68-1f30ba1c7fcf None None] Registered counter for database nova_api May 27 15:05:34.020483 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO dbcounter [None req-cb8aa055-a669-4c95-946f-f99b7c5bd6d3 None None] Registered counter for database nova_api May 27 15:05:34.038212 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_db.sqlalchemy.engines [None req-5ae77594-efc1-46b4-9a68-1f30ba1c7fcf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:05:34.040514 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG oslo_db.sqlalchemy.engines [None req-cb8aa055-a669-4c95-946f-f99b7c5bd6d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:05:34.045622 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writer thread running {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:05:34.047203 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG dbcounter [-] [103304] Writer thread running {{(pid=103304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:05:34.104110 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.context [None req-5ae77594-efc1-46b4-9a68-1f30ba1c7fcf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),73a26acb-fd81-476d-b23a-413b6c7fb5a6(cell1) {{(pid=103305) load_cells /opt/stack/nova/nova/context.py:464}} May 27 15:05:34.104938 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.context [None req-cb8aa055-a669-4c95-946f-f99b7c5bd6d3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),73a26acb-fd81-476d-b23a-413b6c7fb5a6(cell1) {{(pid=103304) load_cells /opt/stack/nova/nova/context.py:464}} May 27 15:05:34.108525 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-5ae77594-efc1-46b4-9a68-1f30ba1c7fcf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:34.109281 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG oslo_concurrency.lockutils [None req-cb8aa055-a669-4c95-946f-f99b7c5bd6d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:34.110109 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-5ae77594-efc1-46b4-9a68-1f30ba1c7fcf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:34.110865 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG oslo_concurrency.lockutils [None req-cb8aa055-a669-4c95-946f-f99b7c5bd6d3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:34.110975 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-5ae77594-efc1-46b4-9a68-1f30ba1c7fcf None None] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:34.111649 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG oslo_concurrency.lockutils [None req-cb8aa055-a669-4c95-946f-f99b7c5bd6d3 None None] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:05:34.112895 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-5ae77594-efc1-46b4-9a68-1f30ba1c7fcf None None] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:34.113594 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG oslo_concurrency.lockutils [None req-cb8aa055-a669-4c95-946f-f99b7c5bd6d3 None None] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:05:34.114890 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO dbcounter [None req-5ae77594-efc1-46b4-9a68-1f30ba1c7fcf None None] Registered counter for database nova_cell0 May 27 15:05:34.115602 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO dbcounter [None req-cb8aa055-a669-4c95-946f-f99b7c5bd6d3 None None] Registered counter for database nova_cell0 May 27 15:05:34.119803 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO dbcounter [None req-5ae77594-efc1-46b4-9a68-1f30ba1c7fcf None None] Registered counter for database nova_cell1 May 27 15:05:34.120286 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO dbcounter [None req-cb8aa055-a669-4c95-946f-f99b7c5bd6d3 None None] Registered counter for database nova_cell1 May 27 15:05:34.126984 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_db.sqlalchemy.engines [None req-5ae77594-efc1-46b4-9a68-1f30ba1c7fcf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:05:34.128605 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG oslo_db.sqlalchemy.engines [None req-cb8aa055-a669-4c95-946f-f99b7c5bd6d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:05:34.131639 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writer thread running {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:05:34.131845 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG oslo_db.sqlalchemy.engines [None req-cb8aa055-a669-4c95-946f-f99b7c5bd6d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:05:34.137051 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG dbcounter [-] [103304] Writer thread running {{(pid=103304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:05:34.139211 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG dbcounter [-] [103304] Writer thread running {{(pid=103304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:05:34.279510 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_db.sqlalchemy.engines [None req-5ae77594-efc1-46b4-9a68-1f30ba1c7fcf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:05:34.285118 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writer thread running {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:05:34.294583 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO dbcounter [None req-5ae77594-efc1-46b4-9a68-1f30ba1c7fcf None None] Registered counter for database nova_cell0 May 27 15:05:34.295571 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO dbcounter [None req-cb8aa055-a669-4c95-946f-f99b7c5bd6d3 None None] Registered counter for database nova_cell0 May 27 15:05:34.301381 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_db.sqlalchemy.engines [None req-5ae77594-efc1-46b4-9a68-1f30ba1c7fcf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:05:34.303069 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG oslo_db.sqlalchemy.engines [None req-cb8aa055-a669-4c95-946f-f99b7c5bd6d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:05:34.306546 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writer thread running {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:05:34.308228 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG dbcounter [-] [103304] Writer thread running {{(pid=103304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:05:34.650904 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: WARNING keystonemiddleware.auth_token [None req-5ae77594-efc1-46b4-9a68-1f30ba1c7fcf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 15:05:34.658051 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: WARNING keystonemiddleware.auth_token [None req-5ae77594-efc1-46b4-9a68-1f30ba1c7fcf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 15:05:34.658214 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: WARNING keystonemiddleware.auth_token [None req-cb8aa055-a669-4c95-946f-f99b7c5bd6d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 15:05:34.666081 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: WARNING keystonemiddleware.auth_token [None req-cb8aa055-a669-4c95-946f-f99b7c5bd6d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 15:05:35.005375 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: WARNING keystonemiddleware.auth_token [None req-5ae77594-efc1-46b4-9a68-1f30ba1c7fcf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 15:05:35.009840 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: WARNING keystonemiddleware.auth_token [None req-cb8aa055-a669-4c95-946f-f99b7c5bd6d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 15:05:35.011366 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: WARNING keystonemiddleware.auth_token [None req-5ae77594-efc1-46b4-9a68-1f30ba1c7fcf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 15:05:35.015806 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: WARNING keystonemiddleware.auth_token [None req-cb8aa055-a669-4c95-946f-f99b7c5bd6d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 15:05:35.016634 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ad0c0c69c0 pid: 103305 (default app) May 27 15:05:35.018687 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-5ae77594-efc1-46b4-9a68-1f30ba1c7fcf None None] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:05:35.019909 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-5ae77594-efc1-46b4-9a68-1f30ba1c7fcf None None] 10.222.0.50 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001772 May 27 15:05:35.020591 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 788 bytes} [Fri May 27 15:05:35 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:05:35.021031 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ad0c0c69c0 pid: 103304 (default app) May 27 15:06:53.392066 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-5ae77594-efc1-46b4-9a68-1f30ba1c7fcf None None] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:53.393089 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-5ae77594-efc1-46b4-9a68-1f30ba1c7fcf None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 27 15:06:53.393643 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 2/2] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 15:06:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:53.406784 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG dbcounter [-] [103304] Writing DB stats nova_api:SELECT=3 {{(pid=103304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:53.408126 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG dbcounter [-] [103304] Writing DB stats nova_cell0:SELECT=3 {{(pid=103304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:53.408847 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG dbcounter [-] [103304] Writing DB stats nova_cell1:SELECT=3 {{(pid=103304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:53.410157 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG dbcounter [-] [103304] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:53.843895 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-6d634730-ccba-4cc5-a1ff-c52bbbadd31b admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:53.875168 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-6d634730-ccba-4cc5-a1ff-c52bbbadd31b admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.473588 May 27 15:06:53.876059 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 1/3] 10.222.0.50 () {60 vars in 1291 bytes} [Fri May 27 15:06:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:56.163502 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-5ae77594-efc1-46b4-9a68-1f30ba1c7fcf None None] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:56.165137 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-5ae77594-efc1-46b4-9a68-1f30ba1c7fcf None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002149 May 27 15:06:56.165984 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 3/4] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 15:06:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:56.226496 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-17131187-2c7d-433e-9866-e5ae0f3e9917 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256}} {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:56.246887 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:06:56.246887 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: warnings.warn(msg) May 27 15:06:56.277427 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-17131187-2c7d-433e-9866-e5ae0f3e9917 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105693 May 27 15:06:56.277983 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 2/5] 10.222.0.50 () {64 vars in 1282 bytes} [Fri May 27 15:06:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:06:56.520505 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-11d1fb65-02cc-4ab2-a15a-891f38290d47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:56.523050 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:06:56.523050 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: warnings.warn(msg) May 27 15:06:56.525958 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_api:SELECT=3 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:56.527041 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_cell1:SELECT=3 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:56.528120 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_cell0:SELECT=3 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:56.528929 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:06:56.598275 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-11d1fb65-02cc-4ab2-a15a-891f38290d47 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.311975 May 27 15:06:56.598999 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 4/6] 10.222.0.50 () {64 vars in 1335 bytes} [Fri May 27 15:06:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:06:58.932670 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-17131187-2c7d-433e-9866-e5ae0f3e9917 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:06:58.933745 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-17131187-2c7d-433e-9866-e5ae0f3e9917 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001605 May 27 15:06:58.934308 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 3/7] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 15:06:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:06:59.050449 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-8b3a5408-01f3-4975-ad75-bf8376ecc01d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "ram": 512, "rxtx_factor": 1.0}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:59.068428 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:06:59.068428 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: warnings.warn(msg) May 27 15:06:59.088076 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-8b3a5408-01f3-4975-ad75-bf8376ecc01d admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.147537 May 27 15:06:59.088629 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 5/8] 10.222.0.50 () {64 vars in 1282 bytes} [Fri May 27 15:06:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:06:59.100814 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-06a87c8b-0955-424c-b397-c09fb1dff9ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:06:59.102830 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:06:59.102830 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: warnings.warn(msg) May 27 15:06:59.135090 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-06a87c8b-0955-424c-b397-c09fb1dff9ab admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037923 May 27 15:06:59.135589 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 4/9] 10.222.0.50 () {64 vars in 1335 bytes} [Fri May 27 15:06:59 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:01.396793 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-8b3a5408-01f3-4975-ad75-bf8376ecc01d admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:01.397809 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-8b3a5408-01f3-4975-ad75-bf8376ecc01d admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 27 15:07:01.399082 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 6/10] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 15:07:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:01.460319 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-c138f481-acc4-484b-9e2a-5572aea9fddd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "id": "d2", "name": "ds1G", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:01.481150 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-c138f481-acc4-484b-9e2a-5572aea9fddd admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076379 May 27 15:07:01.488897 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 5/11] 10.222.0.50 () {64 vars in 1282 bytes} [Fri May 27 15:07:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:07:01.495457 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-fcaa90b2-16f4-456c-a652-55d00bc54272 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:01.522284 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-fcaa90b2-16f4-456c-a652-55d00bc54272 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030990 May 27 15:07:01.523789 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 7/12] 10.222.0.50 () {64 vars in 1335 bytes} [Fri May 27 15:07:01 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:03.797951 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-c138f481-acc4-484b-9e2a-5572aea9fddd admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:03.799209 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-c138f481-acc4-484b-9e2a-5572aea9fddd admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001642 May 27 15:07:03.799625 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 6/13] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 15:07:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:03.863792 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-fc0b3edc-cf5d-4787-9f58-418f806be42b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "vcpus": 2, "swap": 0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "os-flavor-access:is_public": true, "disk": 10}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:03.885794 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-fc0b3edc-cf5d-4787-9f58-418f806be42b admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079183 May 27 15:07:03.886279 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 8/14] 10.222.0.50 () {64 vars in 1282 bytes} [Fri May 27 15:07:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:07:03.899408 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-baa8c697-b3e6-4fd8-ae78-85a4cb4ac07f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:03.923957 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-baa8c697-b3e6-4fd8-ae78-85a4cb4ac07f admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029104 May 27 15:07:03.924778 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 7/15] 10.222.0.50 () {64 vars in 1335 bytes} [Fri May 27 15:07:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:07:06.210764 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-fc0b3edc-cf5d-4787-9f58-418f806be42b admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:06.211785 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-fc0b3edc-cf5d-4787-9f58-418f806be42b admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 May 27 15:07:06.213140 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 9/16] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 15:07:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:06.272416 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-ea7b9282-d8f7-4ef2-9785-210e0e335d12 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4"}} {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:06.290645 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-ea7b9282-d8f7-4ef2-9785-210e0e335d12 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072190 May 27 15:07:06.291441 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 8/17] 10.222.0.50 () {64 vars in 1282 bytes} [Fri May 27 15:07:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:07:06.303264 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-5f99e85d-17b6-4082-bc19-29b04e4a5700 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:06.328650 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-5f99e85d-17b6-4082-bc19-29b04e4a5700 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028991 May 27 15:07:06.329520 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 10/18] 10.222.0.50 () {64 vars in 1335 bytes} [Fri May 27 15:07:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:08.740583 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-ea7b9282-d8f7-4ef2-9785-210e0e335d12 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:08.741674 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-ea7b9282-d8f7-4ef2-9785-210e0e335d12 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 27 15:07:08.742759 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 9/19] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 15:07:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:08.801019 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-85516b3b-8f17-438a-9e0c-e7cc901c5123 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:08.823782 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-85516b3b-8f17-438a-9e0c-e7cc901c5123 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.074976 May 27 15:07:08.824519 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 11/20] 10.222.0.50 () {60 vars in 1291 bytes} [Fri May 27 15:07:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:11.123464 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-ea7b9282-d8f7-4ef2-9785-210e0e335d12 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:11.124826 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-ea7b9282-d8f7-4ef2-9785-210e0e335d12 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001956 May 27 15:07:11.125391 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 10/21] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 15:07:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:11.193627 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-3d7a9693-fba6-4f19-a1e1-a28740cc2696 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "id": "1", "vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "ram": 512}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:11.214028 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-3d7a9693-fba6-4f19-a1e1-a28740cc2696 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.082402 May 27 15:07:11.214603 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 12/22] 10.222.0.50 () {64 vars in 1282 bytes} [Fri May 27 15:07:11 2022] POST /compute/v2.1/flavors => generated 402 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 15:07:11.229217 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-48893a9e-0956-43d6-9433-b35a27cda916 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:11.260128 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-48893a9e-0956-43d6-9433-b35a27cda916 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036212 May 27 15:07:11.260867 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 11/23] 10.222.0.50 () {64 vars in 1332 bytes} [Fri May 27 15:07:11 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:13.942664 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-3d7a9693-fba6-4f19-a1e1-a28740cc2696 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:13.943723 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-3d7a9693-fba6-4f19-a1e1-a28740cc2696 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 May 27 15:07:13.944273 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 13/24] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 15:07:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:14.011337 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-3910ab14-fee7-466e-9813-7ca6ed03fa6b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "disk": 20, "id": "2", "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:14.030037 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-3910ab14-fee7-466e-9813-7ca6ed03fa6b admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079816 May 27 15:07:14.030602 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 12/25] 10.222.0.50 () {64 vars in 1282 bytes} [Fri May 27 15:07:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:07:14.045070 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-0f6e39ad-efc9-468c-88db-6c900d419364 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:14.073056 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-0f6e39ad-efc9-468c-88db-6c900d419364 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033275 May 27 15:07:14.073627 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 14/26] 10.222.0.50 () {64 vars in 1332 bytes} [Fri May 27 15:07:14 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:16.405250 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-3910ab14-fee7-466e-9813-7ca6ed03fa6b admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:16.406283 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-3910ab14-fee7-466e-9813-7ca6ed03fa6b admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 May 27 15:07:16.406686 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 13/27] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 15:07:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:16.465479 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-d03c2e1b-d4b8-4c8c-9b7c-58e0d54921e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:16.484127 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-d03c2e1b-d4b8-4c8c-9b7c-58e0d54921e6 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071379 May 27 15:07:16.484672 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 15/28] 10.222.0.50 () {64 vars in 1282 bytes} [Fri May 27 15:07:16 2022] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:07:16.497120 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-1e9e1c77-0c71-4948-8630-ab68d8dcaaca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:16.520026 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-1e9e1c77-0c71-4948-8630-ab68d8dcaaca admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026670 May 27 15:07:16.520600 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 14/29] 10.222.0.50 () {64 vars in 1332 bytes} [Fri May 27 15:07:16 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:07:18.778014 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-d03c2e1b-d4b8-4c8c-9b7c-58e0d54921e6 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:18.779149 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-d03c2e1b-d4b8-4c8c-9b7c-58e0d54921e6 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 May 27 15:07:18.779615 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 16/30] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 15:07:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:18.840870 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-86c09736-0bd9-4732-a413-1ffa2314b0b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "name": "m1.large", "ram": 8192}} {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:18.859140 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-86c09736-0bd9-4732-a413-1ffa2314b0b0 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073478 May 27 15:07:18.859696 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 15/31] 10.222.0.50 () {64 vars in 1282 bytes} [Fri May 27 15:07:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 15:07:18.871723 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-53298c07-0fc1-4497-a895-764b1edf13d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:18.897361 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-53298c07-0fc1-4497-a895-764b1edf13d9 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029181 May 27 15:07:18.898569 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 17/32] 10.222.0.50 () {64 vars in 1332 bytes} [Fri May 27 15:07:18 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:07:21.280442 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-86c09736-0bd9-4732-a413-1ffa2314b0b0 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:21.281458 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-86c09736-0bd9-4732-a413-1ffa2314b0b0 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 27 15:07:21.281859 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 16/33] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 15:07:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:21.344108 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-57611907-d007-4ab5-abb7-eb853f03afbf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "name": "m1.xlarge", "rxtx_factor": 1.0, "ram": 16384, "id": "5", "os-flavor-access:is_public": true, "disk": 160}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:21.364207 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-57611907-d007-4ab5-abb7-eb853f03afbf admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076167 May 27 15:07:21.364758 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 18/34] 10.222.0.50 () {64 vars in 1282 bytes} [Fri May 27 15:07:21 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:07:21.377859 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-11b2cbc1-627f-46fe-8e7f-8abec96aadbe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:21.402059 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-11b2cbc1-627f-46fe-8e7f-8abec96aadbe admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028590 May 27 15:07:21.402742 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 17/35] 10.222.0.50 () {64 vars in 1332 bytes} [Fri May 27 15:07:21 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:07:45.563273 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-57611907-d007-4ab5-abb7-eb853f03afbf admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:45.564292 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-57611907-d007-4ab5-abb7-eb853f03afbf admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 May 27 15:07:45.564706 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 19/36] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 15:07:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:45.575432 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG dbcounter [-] [103304] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:45.623939 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-61a9a022-159f-41ae-bf43-a4bbceab0586 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:45.640782 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-61a9a022-159f-41ae-bf43-a4bbceab0586 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069872 May 27 15:07:45.641312 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 18/37] 10.222.0.50 () {60 vars in 1291 bytes} [Fri May 27 15:07:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:46.638909 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-57611907-d007-4ab5-abb7-eb853f03afbf admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:46.639921 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-57611907-d007-4ab5-abb7-eb853f03afbf admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 27 15:07:46.640318 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 20/38] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 15:07:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:46.848436 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-a8e3db41-8ac4-4358-998b-3874bedf2d69 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:46.855050 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.wsgi [None req-a8e3db41-8ac4-4358-998b-3874bedf2d69 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 27 15:07:46.858295 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-a8e3db41-8ac4-4358-998b-3874bedf2d69 admin admin] Request method failure captured: May 27 15:07:46.858295 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 27 15:07:46.858295 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: Accept: application/json May 27 15:07:46.858295 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: Accept-Encoding: gzip, deflate May 27 15:07:46.858295 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: Connection: keep-alive May 27 15:07:46.858295 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: Content-Length: 0 May 27 15:07:46.858295 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: Host: 10.222.0.50 May 27 15:07:46.858295 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: Openstack-Api-Version: compute 2.90 May 27 15:07:46.858295 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: Openstack-System-Scope: None May 27 15:07:46.858295 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: User-Agent: python-novaclient May 27 15:07:46.858295 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Auth-Token: gAAAAABikOlC74_bC01pDsn9GJ7_CqoD_XV-V8gwfWtbK2gZcZ8cp4rL3v6qzxdo3qhsMNhq_YvjauoK6RC0JXPYfR0jxCi-8cpqZKrR82hUL_S8UMJpjIpsZdE_pRzrbqTtfHWYI3yyjhIDerefGEAqTycy2le3C8SwUbBZcYAscgmyXkA9tuc May 27 15:07:46.858295 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Domain-Id: None May 27 15:07:46.858295 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Domain-Name: None May 27 15:07:46.858295 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Identity-Status: Confirmed May 27 15:07:46.858295 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Is-Admin-Project: True May 27 15:07:46.858295 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Openstack-Nova-Api-Version: 2.90 May 27 15:07:46.858295 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Project-Domain-Id: default May 27 15:07:46.858295 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Project-Domain-Name: Default May 27 15:07:46.858295 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Project-Id: 6fdd45226b7e4d17bd9b93b1a5b70196 May 27 15:07:46.858295 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Project-Name: admin May 27 15:07:46.858295 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Role: reader,admin,member May 27 15:07:46.858295 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Roles: reader,admin,member May 27 15:07:46.859832 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:07:46.859832 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Tenant: admin May 27 15:07:46.859832 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Tenant-Id: 6fdd45226b7e4d17bd9b93b1a5b70196 May 27 15:07:46.859832 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Tenant-Name: admin May 27 15:07:46.859832 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-User: admin May 27 15:07:46.859832 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-User-Domain-Id: default May 27 15:07:46.859832 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-User-Domain-Name: Default May 27 15:07:46.859832 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-User-Id: 9c29995c0b564cd7879c58c75dc099cb May 27 15:07:46.859832 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-User-Name: admin May 27 15:07:46.859832 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: method: > May 27 15:07:46.859832 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: exception: Flavor 42 could not be found. May 27 15:07:46.859832 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: action_args: {'id': '42'} May 27 15:07:46.859832 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:07:46.859832 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:46.860743 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 15:07:46.860743 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 15:07:46.860743 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 15:07:46.860743 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 15:07:46.860743 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:07:46.860743 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:07:46.860743 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 15:07:46.860743 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 15:07:46.860743 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 15:07:46.860743 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:07:46.860743 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 15:07:46.860743 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 15:07:46.860743 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 27 15:07:46.860743 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi May 27 15:07:46.860743 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:46.860743 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi May 27 15:07:46.860743 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:46.860743 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:46.860743 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:46.861991 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:07:46.861991 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:07:46.861991 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:07:46.861991 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:07:46.861991 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 15:07:46.861991 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 15:07:46.861991 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 27 15:07:46.861991 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi May 27 15:07:46.861991 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:46.861991 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi May 27 15:07:46.861991 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:46.861991 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:46.861991 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:46.861991 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:07:46.861991 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:07:46.861991 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 27 15:07:46.861991 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi May 27 15:07:46.861991 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-a8e3db41-8ac4-4358-998b-3874bedf2d69 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:07:46.863159 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-a8e3db41-8ac4-4358-998b-3874bedf2d69 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063001 May 27 15:07:46.863159 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 19/39] 10.222.0.50 () {60 vars in 1190 bytes} [Fri May 27 15:07:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 15:07:46.870799 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-7fda9780-4984-490c-837b-31a28655b976 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:46.873652 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:07:46.893618 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-7fda9780-4984-490c-837b-31a28655b976 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027678 May 27 15:07:46.894177 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 21/40] 10.222.0.50 () {60 vars in 1210 bytes} [Fri May 27 15:07:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:46.903897 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-7d3948f7-fef3-4e7e-be4d-b7be77cce4a0 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:46.925704 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-7d3948f7-fef3-4e7e-be4d-b7be77cce4a0 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025341 May 27 15:07:46.926240 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 20/41] 10.222.0.50 () {60 vars in 1210 bytes} [Fri May 27 15:07:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:46.936229 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-f7c52607-eb6d-4470-ad2d-3f8bd80f0f68 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:46.942663 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.wsgi [None req-f7c52607-eb6d-4470-ad2d-3f8bd80f0f68 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 27 15:07:46.946177 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-f7c52607-eb6d-4470-ad2d-3f8bd80f0f68 admin admin] Request method failure captured: May 27 15:07:46.946177 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 27 15:07:46.946177 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: Accept: application/json May 27 15:07:46.946177 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: Accept-Encoding: gzip, deflate May 27 15:07:46.946177 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: Connection: keep-alive May 27 15:07:46.946177 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: Content-Length: 0 May 27 15:07:46.946177 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: Host: 10.222.0.50 May 27 15:07:46.946177 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: Openstack-Api-Version: compute 2.90 May 27 15:07:46.946177 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: Openstack-System-Scope: None May 27 15:07:46.946177 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: User-Agent: python-novaclient May 27 15:07:46.946177 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Auth-Token: gAAAAABikOlC74_bC01pDsn9GJ7_CqoD_XV-V8gwfWtbK2gZcZ8cp4rL3v6qzxdo3qhsMNhq_YvjauoK6RC0JXPYfR0jxCi-8cpqZKrR82hUL_S8UMJpjIpsZdE_pRzrbqTtfHWYI3yyjhIDerefGEAqTycy2le3C8SwUbBZcYAscgmyXkA9tuc May 27 15:07:46.946177 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Domain-Id: None May 27 15:07:46.946177 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Domain-Name: None May 27 15:07:46.946177 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Identity-Status: Confirmed May 27 15:07:46.946177 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Is-Admin-Project: True May 27 15:07:46.946177 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Openstack-Nova-Api-Version: 2.90 May 27 15:07:46.946177 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Project-Domain-Id: default May 27 15:07:46.946177 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Project-Domain-Name: Default May 27 15:07:46.946177 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Project-Id: 6fdd45226b7e4d17bd9b93b1a5b70196 May 27 15:07:46.946177 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Project-Name: admin May 27 15:07:46.946177 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Role: reader,admin,member May 27 15:07:46.946177 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Roles: reader,admin,member May 27 15:07:46.947782 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:07:46.947782 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Tenant: admin May 27 15:07:46.947782 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Tenant-Id: 6fdd45226b7e4d17bd9b93b1a5b70196 May 27 15:07:46.947782 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Tenant-Name: admin May 27 15:07:46.947782 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-User: admin May 27 15:07:46.947782 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-User-Domain-Id: default May 27 15:07:46.947782 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-User-Domain-Name: Default May 27 15:07:46.947782 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-User-Id: 9c29995c0b564cd7879c58c75dc099cb May 27 15:07:46.947782 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-User-Name: admin May 27 15:07:46.947782 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: method: > May 27 15:07:46.947782 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: exception: Flavor 42 could not be found. May 27 15:07:46.947782 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: action_args: {'id': '42'} May 27 15:07:46.947782 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:07:46.947782 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:46.948763 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 15:07:46.948763 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 15:07:46.948763 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 15:07:46.948763 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 15:07:46.948763 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:07:46.948763 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:07:46.948763 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 15:07:46.948763 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 15:07:46.948763 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 15:07:46.948763 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:07:46.948763 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 15:07:46.948763 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 15:07:46.948763 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 27 15:07:46.948763 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi May 27 15:07:46.948763 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:46.948763 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi May 27 15:07:46.948763 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:46.948763 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:46.948763 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:46.950028 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:07:46.950028 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:07:46.950028 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:07:46.950028 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:07:46.950028 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 15:07:46.950028 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 15:07:46.950028 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 27 15:07:46.950028 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi May 27 15:07:46.950028 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:46.950028 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi May 27 15:07:46.950028 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:46.950028 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:46.950028 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:46.950028 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:07:46.950028 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:07:46.950028 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 27 15:07:46.950028 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi May 27 15:07:46.950028 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-f7c52607-eb6d-4470-ad2d-3f8bd80f0f68 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:07:46.951299 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-f7c52607-eb6d-4470-ad2d-3f8bd80f0f68 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014917 May 27 15:07:46.951299 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 22/42] 10.222.0.50 () {60 vars in 1190 bytes} [Fri May 27 15:07:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 15:07:47.819896 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-7d3948f7-fef3-4e7e-be4d-b7be77cce4a0 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:47.820938 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-7d3948f7-fef3-4e7e-be4d-b7be77cce4a0 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 May 27 15:07:47.821331 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 21/43] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 15:07:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:48.013056 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-c2ac6ace-fd3c-4306-9ebd-9d1026d1462d admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:48.018997 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.wsgi [None req-c2ac6ace-fd3c-4306-9ebd-9d1026d1462d admin admin] HTTP exception thrown: Flavor 84 could not be found. May 27 15:07:48.020487 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-c2ac6ace-fd3c-4306-9ebd-9d1026d1462d admin admin] Request method failure captured: May 27 15:07:48.020487 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 27 15:07:48.020487 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: Accept: application/json May 27 15:07:48.020487 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: Accept-Encoding: gzip, deflate May 27 15:07:48.020487 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: Connection: keep-alive May 27 15:07:48.020487 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: Content-Length: 0 May 27 15:07:48.020487 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: Host: 10.222.0.50 May 27 15:07:48.020487 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: Openstack-Api-Version: compute 2.90 May 27 15:07:48.020487 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: Openstack-System-Scope: None May 27 15:07:48.020487 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: User-Agent: python-novaclient May 27 15:07:48.020487 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Auth-Token: gAAAAABikOlDu0b_X1yqIQArvjSrVHSVisZ3LaJfiLhm8PciKSdWTfZ5QDJfO5hUOUhlKmHHOdc1r0Zm0LXTn8fl6etNeaXjcy4l8sbrSV8gCFKn9a0i2o2SY4d-WIsHk0v4WRwTmfLFnn4AmHdnaQqFpuedNESCnie3bmaA-EBzrQ07BzvhCNY May 27 15:07:48.020487 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Domain-Id: None May 27 15:07:48.020487 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Domain-Name: None May 27 15:07:48.020487 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Identity-Status: Confirmed May 27 15:07:48.020487 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Is-Admin-Project: True May 27 15:07:48.020487 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Openstack-Nova-Api-Version: 2.90 May 27 15:07:48.020487 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Project-Domain-Id: default May 27 15:07:48.020487 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Project-Domain-Name: Default May 27 15:07:48.020487 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Project-Id: 6fdd45226b7e4d17bd9b93b1a5b70196 May 27 15:07:48.020487 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Project-Name: admin May 27 15:07:48.020487 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Role: reader,admin,member May 27 15:07:48.020487 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Roles: reader,admin,member May 27 15:07:48.022565 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:07:48.022565 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Tenant: admin May 27 15:07:48.022565 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Tenant-Id: 6fdd45226b7e4d17bd9b93b1a5b70196 May 27 15:07:48.022565 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Tenant-Name: admin May 27 15:07:48.022565 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-User: admin May 27 15:07:48.022565 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-User-Domain-Id: default May 27 15:07:48.022565 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-User-Domain-Name: Default May 27 15:07:48.022565 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-User-Id: 9c29995c0b564cd7879c58c75dc099cb May 27 15:07:48.022565 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-User-Name: admin May 27 15:07:48.022565 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: method: > May 27 15:07:48.022565 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: exception: Flavor 84 could not be found. May 27 15:07:48.022565 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: action_args: {'id': '84'} May 27 15:07:48.022565 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:07:48.022565 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:48.023583 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 15:07:48.023583 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 15:07:48.023583 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 15:07:48.023583 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 15:07:48.023583 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:07:48.023583 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:07:48.023583 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 15:07:48.023583 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 15:07:48.023583 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 15:07:48.023583 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:07:48.023583 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 15:07:48.023583 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 15:07:48.023583 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 27 15:07:48.023583 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi May 27 15:07:48.023583 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:48.023583 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi May 27 15:07:48.023583 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:48.023583 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:48.023583 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:48.024889 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:07:48.024889 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:07:48.024889 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:07:48.024889 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:07:48.024889 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 15:07:48.024889 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 15:07:48.024889 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 27 15:07:48.024889 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi May 27 15:07:48.024889 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:48.024889 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi May 27 15:07:48.024889 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:48.024889 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:48.024889 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:48.024889 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:07:48.024889 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:07:48.024889 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 27 15:07:48.024889 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi May 27 15:07:48.024889 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-c2ac6ace-fd3c-4306-9ebd-9d1026d1462d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:07:48.026182 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-c2ac6ace-fd3c-4306-9ebd-9d1026d1462d admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061328 May 27 15:07:48.026182 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 23/44] 10.222.0.50 () {60 vars in 1190 bytes} [Fri May 27 15:07:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 15:07:48.032283 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-383ecf65-b44d-41dd-b961-72941648bc88 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:48.048045 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-383ecf65-b44d-41dd-b961-72941648bc88 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019378 May 27 15:07:48.048571 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 22/45] 10.222.0.50 () {60 vars in 1210 bytes} [Fri May 27 15:07:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:07:48.057911 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-d488abb2-da9e-4558-b989-c50735901189 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:48.071534 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-d488abb2-da9e-4558-b989-c50735901189 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017127 May 27 15:07:48.072055 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 24/46] 10.222.0.50 () {60 vars in 1210 bytes} [Fri May 27 15:07:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:48.081283 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-30967ab1-3a6f-472a-802b-8f88dfcba52f admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:48.087214 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.wsgi [None req-30967ab1-3a6f-472a-802b-8f88dfcba52f admin admin] HTTP exception thrown: Flavor 84 could not be found. May 27 15:07:48.088720 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-30967ab1-3a6f-472a-802b-8f88dfcba52f admin admin] Request method failure captured: May 27 15:07:48.088720 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 27 15:07:48.088720 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: Accept: application/json May 27 15:07:48.088720 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: Accept-Encoding: gzip, deflate May 27 15:07:48.088720 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: Connection: keep-alive May 27 15:07:48.088720 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: Content-Length: 0 May 27 15:07:48.088720 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: Host: 10.222.0.50 May 27 15:07:48.088720 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: Openstack-Api-Version: compute 2.90 May 27 15:07:48.088720 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: Openstack-System-Scope: None May 27 15:07:48.088720 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: User-Agent: python-novaclient May 27 15:07:48.088720 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Auth-Token: gAAAAABikOlDu0b_X1yqIQArvjSrVHSVisZ3LaJfiLhm8PciKSdWTfZ5QDJfO5hUOUhlKmHHOdc1r0Zm0LXTn8fl6etNeaXjcy4l8sbrSV8gCFKn9a0i2o2SY4d-WIsHk0v4WRwTmfLFnn4AmHdnaQqFpuedNESCnie3bmaA-EBzrQ07BzvhCNY May 27 15:07:48.088720 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Domain-Id: None May 27 15:07:48.088720 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Domain-Name: None May 27 15:07:48.088720 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Identity-Status: Confirmed May 27 15:07:48.088720 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Is-Admin-Project: True May 27 15:07:48.088720 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Openstack-Nova-Api-Version: 2.90 May 27 15:07:48.088720 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Project-Domain-Id: default May 27 15:07:48.088720 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Project-Domain-Name: Default May 27 15:07:48.088720 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Project-Id: 6fdd45226b7e4d17bd9b93b1a5b70196 May 27 15:07:48.088720 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Project-Name: admin May 27 15:07:48.088720 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Role: reader,admin,member May 27 15:07:48.088720 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Roles: reader,admin,member May 27 15:07:48.090514 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:07:48.090514 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Tenant: admin May 27 15:07:48.090514 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Tenant-Id: 6fdd45226b7e4d17bd9b93b1a5b70196 May 27 15:07:48.090514 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Tenant-Name: admin May 27 15:07:48.090514 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-User: admin May 27 15:07:48.090514 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-User-Domain-Id: default May 27 15:07:48.090514 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-User-Domain-Name: Default May 27 15:07:48.090514 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-User-Id: 9c29995c0b564cd7879c58c75dc099cb May 27 15:07:48.090514 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-User-Name: admin May 27 15:07:48.090514 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: method: > May 27 15:07:48.090514 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: exception: Flavor 84 could not be found. May 27 15:07:48.090514 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: action_args: {'id': '84'} May 27 15:07:48.090514 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:07:48.090514 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:48.091518 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 15:07:48.091518 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 15:07:48.091518 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 15:07:48.091518 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 15:07:48.091518 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:07:48.091518 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:07:48.091518 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 15:07:48.091518 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 15:07:48.091518 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 15:07:48.091518 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:07:48.091518 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 15:07:48.091518 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 15:07:48.091518 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 27 15:07:48.091518 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi May 27 15:07:48.091518 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:48.091518 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi May 27 15:07:48.091518 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:48.091518 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:48.091518 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:48.092799 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:07:48.092799 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:07:48.092799 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:07:48.092799 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:07:48.092799 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 15:07:48.092799 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 15:07:48.092799 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 27 15:07:48.092799 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi May 27 15:07:48.092799 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:48.092799 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi May 27 15:07:48.092799 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:48.092799 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:48.092799 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:48.092799 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:07:48.092799 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:07:48.092799 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 27 15:07:48.092799 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi May 27 15:07:48.092799 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-30967ab1-3a6f-472a-802b-8f88dfcba52f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:07:48.094067 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-30967ab1-3a6f-472a-802b-8f88dfcba52f admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012334 May 27 15:07:48.094067 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 23/47] 10.222.0.50 () {60 vars in 1190 bytes} [Fri May 27 15:07:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 15:07:48.960713 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-d488abb2-da9e-4558-b989-c50735901189 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:48.961729 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-d488abb2-da9e-4558-b989-c50735901189 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001944 May 27 15:07:48.962126 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 25/48] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 15:07:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:49.152916 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-3f244a08-28ee-4bca-a3c7-aef50475ff2d admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:49.158814 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.wsgi [None req-3f244a08-28ee-4bca-a3c7-aef50475ff2d admin admin] HTTP exception thrown: Flavor 451 could not be found. May 27 15:07:49.160360 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-3f244a08-28ee-4bca-a3c7-aef50475ff2d admin admin] Request method failure captured: May 27 15:07:49.160360 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 27 15:07:49.160360 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: Accept: application/json May 27 15:07:49.160360 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: Accept-Encoding: gzip, deflate May 27 15:07:49.160360 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: Connection: keep-alive May 27 15:07:49.160360 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: Content-Length: 0 May 27 15:07:49.160360 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: Host: 10.222.0.50 May 27 15:07:49.160360 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: Openstack-Api-Version: compute 2.90 May 27 15:07:49.160360 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: Openstack-System-Scope: None May 27 15:07:49.160360 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: User-Agent: python-novaclient May 27 15:07:49.160360 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Auth-Token: gAAAAABikOlE69sNUGRoYFeifD0oTUX6IyipoihpAvC8Es9N0QWKcMatyB5Im_Z1czDFcKG8yqxnyTzuhAeOl8xUI6UUtq3-94aIGbCogZ3fBn7h77uN6LwGw4YQph0o5mz2VBsVmnF0RtT0kgAcw0bK8xO7QHd-fguOW2oHFgXy68ggaaZcTUg May 27 15:07:49.160360 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Domain-Id: None May 27 15:07:49.160360 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Domain-Name: None May 27 15:07:49.160360 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Identity-Status: Confirmed May 27 15:07:49.160360 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Is-Admin-Project: True May 27 15:07:49.160360 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Openstack-Nova-Api-Version: 2.90 May 27 15:07:49.160360 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Project-Domain-Id: default May 27 15:07:49.160360 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Project-Domain-Name: Default May 27 15:07:49.160360 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Project-Id: 6fdd45226b7e4d17bd9b93b1a5b70196 May 27 15:07:49.160360 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Project-Name: admin May 27 15:07:49.160360 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Role: reader,admin,member May 27 15:07:49.160360 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Roles: reader,admin,member May 27 15:07:49.161893 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:07:49.161893 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Tenant: admin May 27 15:07:49.161893 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Tenant-Id: 6fdd45226b7e4d17bd9b93b1a5b70196 May 27 15:07:49.161893 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-Tenant-Name: admin May 27 15:07:49.161893 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-User: admin May 27 15:07:49.161893 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-User-Domain-Id: default May 27 15:07:49.161893 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-User-Domain-Name: Default May 27 15:07:49.161893 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-User-Id: 9c29995c0b564cd7879c58c75dc099cb May 27 15:07:49.161893 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: X-User-Name: admin May 27 15:07:49.161893 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: method: > May 27 15:07:49.161893 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: exception: Flavor 451 could not be found. May 27 15:07:49.161893 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: action_args: {'id': '451'} May 27 15:07:49.161893 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:07:49.161893 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:49.162961 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 15:07:49.162961 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 15:07:49.162961 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 15:07:49.162961 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 15:07:49.162961 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:07:49.162961 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:07:49.162961 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 15:07:49.162961 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 15:07:49.162961 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 15:07:49.162961 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:07:49.162961 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 15:07:49.162961 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 15:07:49.162961 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 27 15:07:49.162961 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi May 27 15:07:49.162961 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:49.162961 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi May 27 15:07:49.162961 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:49.162961 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:49.162961 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:49.164079 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:07:49.164079 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:07:49.164079 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:07:49.164079 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:07:49.164079 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 15:07:49.164079 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 15:07:49.164079 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 27 15:07:49.164079 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi May 27 15:07:49.164079 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:49.164079 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi May 27 15:07:49.164079 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:49.164079 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:49.164079 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:49.164079 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:07:49.164079 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:07:49.164079 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 27 15:07:49.164079 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi May 27 15:07:49.164079 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-3f244a08-28ee-4bca-a3c7-aef50475ff2d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:07:49.165098 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-3f244a08-28ee-4bca-a3c7-aef50475ff2d admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060215 May 27 15:07:49.165098 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 24/49] 10.222.0.50 () {60 vars in 1193 bytes} [Fri May 27 15:07:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 15:07:49.171598 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-af19e6cb-d3cc-4444-b22c-8031121e15a7 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:49.186686 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-af19e6cb-d3cc-4444-b22c-8031121e15a7 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018594 May 27 15:07:49.187256 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 26/50] 10.222.0.50 () {60 vars in 1210 bytes} [Fri May 27 15:07:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:07:49.197136 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-a43f3e16-4e3d-4c66-8e62-2c4f9a4e815f admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:49.211320 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-a43f3e16-4e3d-4c66-8e62-2c4f9a4e815f admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018226 May 27 15:07:49.211841 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 25/51] 10.222.0.50 () {60 vars in 1210 bytes} [Fri May 27 15:07:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:07:49.221193 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-92536b81-603b-45d0-a8a5-4e878f063925 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:49.226588 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.wsgi [None req-92536b81-603b-45d0-a8a5-4e878f063925 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 27 15:07:49.228095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-92536b81-603b-45d0-a8a5-4e878f063925 admin admin] Request method failure captured: May 27 15:07:49.228095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 27 15:07:49.228095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: Accept: application/json May 27 15:07:49.228095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: Accept-Encoding: gzip, deflate May 27 15:07:49.228095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: Connection: keep-alive May 27 15:07:49.228095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: Content-Length: 0 May 27 15:07:49.228095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: Host: 10.222.0.50 May 27 15:07:49.228095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: Openstack-Api-Version: compute 2.90 May 27 15:07:49.228095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: Openstack-System-Scope: None May 27 15:07:49.228095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: User-Agent: python-novaclient May 27 15:07:49.228095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Auth-Token: gAAAAABikOlE69sNUGRoYFeifD0oTUX6IyipoihpAvC8Es9N0QWKcMatyB5Im_Z1czDFcKG8yqxnyTzuhAeOl8xUI6UUtq3-94aIGbCogZ3fBn7h77uN6LwGw4YQph0o5mz2VBsVmnF0RtT0kgAcw0bK8xO7QHd-fguOW2oHFgXy68ggaaZcTUg May 27 15:07:49.228095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Domain-Id: None May 27 15:07:49.228095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Domain-Name: None May 27 15:07:49.228095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Identity-Status: Confirmed May 27 15:07:49.228095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Is-Admin-Project: True May 27 15:07:49.228095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Openstack-Nova-Api-Version: 2.90 May 27 15:07:49.228095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Project-Domain-Id: default May 27 15:07:49.228095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Project-Domain-Name: Default May 27 15:07:49.228095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Project-Id: 6fdd45226b7e4d17bd9b93b1a5b70196 May 27 15:07:49.228095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Project-Name: admin May 27 15:07:49.228095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Role: reader,admin,member May 27 15:07:49.228095 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Roles: reader,admin,member May 27 15:07:49.230192 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6fdd45226b7e4d17bd9b93b1a5b70196"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:07:49.230192 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Tenant: admin May 27 15:07:49.230192 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Tenant-Id: 6fdd45226b7e4d17bd9b93b1a5b70196 May 27 15:07:49.230192 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-Tenant-Name: admin May 27 15:07:49.230192 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-User: admin May 27 15:07:49.230192 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-User-Domain-Id: default May 27 15:07:49.230192 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-User-Domain-Name: Default May 27 15:07:49.230192 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-User-Id: 9c29995c0b564cd7879c58c75dc099cb May 27 15:07:49.230192 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: X-User-Name: admin May 27 15:07:49.230192 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: method: > May 27 15:07:49.230192 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: exception: Flavor 451 could not be found. May 27 15:07:49.230192 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: action_args: {'id': '451'} May 27 15:07:49.230192 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:07:49.230192 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:49.231764 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 15:07:49.231764 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 15:07:49.231764 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 15:07:49.231764 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 15:07:49.231764 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:07:49.231764 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:07:49.231764 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 15:07:49.231764 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 15:07:49.231764 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 15:07:49.231764 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:07:49.231764 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 15:07:49.231764 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 15:07:49.231764 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 27 15:07:49.231764 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi May 27 15:07:49.231764 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:49.231764 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi May 27 15:07:49.231764 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:49.231764 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:49.231764 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:49.233261 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:07:49.233261 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:07:49.233261 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:07:49.233261 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:07:49.233261 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 15:07:49.233261 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 15:07:49.233261 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 27 15:07:49.233261 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi May 27 15:07:49.233261 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:07:49.233261 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi May 27 15:07:49.233261 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:07:49.233261 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:07:49.233261 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:07:49.233261 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:07:49.233261 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:07:49.233261 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 27 15:07:49.233261 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: ERROR nova.api.openstack.wsgi May 27 15:07:49.233261 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-92536b81-603b-45d0-a8a5-4e878f063925 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:07:49.234524 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-92536b81-603b-45d0-a8a5-4e878f063925 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011708 May 27 15:07:49.234524 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 27/52] 10.222.0.50 () {60 vars in 1193 bytes} [Fri May 27 15:07:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 15:07:50.097799 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-a43f3e16-4e3d-4c66-8e62-2c4f9a4e815f admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:50.098832 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-a43f3e16-4e3d-4c66-8e62-2c4f9a4e815f admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 27 15:07:50.099259 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 26/53] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 15:07:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:50.291702 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-00bdc821-ed6e-441a-abeb-7b8b100da2dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:50.309705 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-00bdc821-ed6e-441a-abeb-7b8b100da2dc admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070663 May 27 15:07:50.310172 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 28/54] 10.222.0.50 () {64 vars in 1235 bytes} [Fri May 27 15:07:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:07:51.189282 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-a43f3e16-4e3d-4c66-8e62-2c4f9a4e815f admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:51.190279 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-a43f3e16-4e3d-4c66-8e62-2c4f9a4e815f admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 May 27 15:07:51.190697 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 27/55] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 15:07:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:51.381349 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-dfe1016b-7c49-4a53-8910-a0b487cb97e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:51.398719 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-dfe1016b-7c49-4a53-8910-a0b487cb97e9 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069912 May 27 15:07:51.399214 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 29/56] 10.222.0.50 () {64 vars in 1235 bytes} [Fri May 27 15:07:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:07:52.281963 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-a43f3e16-4e3d-4c66-8e62-2c4f9a4e815f admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:52.282992 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-a43f3e16-4e3d-4c66-8e62-2c4f9a4e815f admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 May 27 15:07:52.283391 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 28/57] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 15:07:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:07:52.478560 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-9eae292b-fd56-4fbe-b6a0-46a4aeb0f3dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:52.497223 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-9eae292b-fd56-4fbe-b6a0-46a4aeb0f3dd admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.073294 May 27 15:07:52.497761 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 30/58] 10.222.0.50 () {64 vars in 1235 bytes} [Fri May 27 15:07:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:07:53.377264 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-a43f3e16-4e3d-4c66-8e62-2c4f9a4e815f admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:53.378272 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-a43f3e16-4e3d-4c66-8e62-2c4f9a4e815f admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 May 27 15:07:53.378675 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 29/59] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 15:07:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:53.574453 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-d30df45b-ddb9-4c94-8e33-9c01e857b7d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:07:53.593720 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-d30df45b-ddb9-4c94-8e33-9c01e857b7d2 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071843 May 27 15:07:53.594254 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 31/60] 10.222.0.50 () {64 vars in 1235 bytes} [Fri May 27 15:07:53 2022] POST /compute/v2.1/flavors => generated 409 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:07:54.484403 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-a43f3e16-4e3d-4c66-8e62-2c4f9a4e815f admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:54.485398 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-a43f3e16-4e3d-4c66-8e62-2c4f9a4e815f admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 May 27 15:07:54.485789 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 30/61] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 15:07:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:07:54.674926 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-df594b97-a739-48bc-99c0-bed08a83aca0 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:07:54.694687 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-df594b97-a739-48bc-99c0-bed08a83aca0 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071150 May 27 15:07:54.695186 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 32/62] 10.222.0.50 () {60 vars in 1202 bytes} [Fri May 27 15:07:54 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:58.734717 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-a43f3e16-4e3d-4c66-8e62-2c4f9a4e815f admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:58.735785 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-a43f3e16-4e3d-4c66-8e62-2c4f9a4e815f admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 May 27 15:08:58.736190 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 31/63] 10.222.0.50 () {54 vars in 930 bytes} [Fri May 27 15:08:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:08:58.744655 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:58.803726 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-8f4cce67-36d8-4497-8046-dc0ad37b0575 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:58.824226 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-8f4cce67-36d8-4497-8046-dc0ad37b0575 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.081244 May 27 15:08:58.824783 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 33/64] 10.222.0.50 () {60 vars in 1291 bytes} [Fri May 27 15:08:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:08:58.845364 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG dbcounter [-] [103304] Writing DB stats nova_api:SELECT=14 {{(pid=103304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:08:58.849239 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-4abaa4cb-8af6-4433-8a02-32fddf83f679 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:58.857574 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-4abaa4cb-8af6-4433-8a02-32fddf83f679 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013597 May 27 15:08:58.858111 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 32/65] 10.222.0.50 () {60 vars in 1282 bytes} [Fri May 27 15:08:58 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:08:58.870498 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-18a82c7c-4aa8-48ff-ad7f-ee98c2373e73 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:58.878268 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-18a82c7c-4aa8-48ff-ad7f-ee98c2373e73 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011976 May 27 15:08:58.878802 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 34/66] 10.222.0.50 () {60 vars in 1285 bytes} [Fri May 27 15:08:58 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:58.890514 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-f4781a1f-3998-4ab4-bbf0-c2d82fe6d109 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:58.898526 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-f4781a1f-3998-4ab4-bbf0-c2d82fe6d109 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011542 May 27 15:08:58.899133 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 33/67] 10.222.0.50 () {60 vars in 1285 bytes} [Fri May 27 15:08:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:08:58.916130 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-6e673374-2a18-4d7c-976d-1f83bcae58d4 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:08:58.924059 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-6e673374-2a18-4d7c-976d-1f83bcae58d4 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012062 May 27 15:08:58.924537 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 35/68] 10.222.0.50 () {60 vars in 1282 bytes} [Fri May 27 15:08:58 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:12:37.238419 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-f4781a1f-3998-4ab4-bbf0-c2d82fe6d109 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:37.239535 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-f4781a1f-3998-4ab4-bbf0-c2d82fe6d109 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 May 27 15:12:37.239924 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 34/69] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 15:12:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:37.394366 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_api:SELECT=6 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:37.505754 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-e9834659-62a1-42a4-9971-326b549f5c2c admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:37.507590 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:12:37.507590 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: warnings.warn(msg) May 27 15:12:37.508777 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-e9834659-62a1-42a4-9971-326b549f5c2c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:37.509220 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-e9834659-62a1-42a4-9971-326b549f5c2c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:37.510001 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-e9834659-62a1-42a4-9971-326b549f5c2c admin admin] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:37.510433 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-e9834659-62a1-42a4-9971-326b549f5c2c admin admin] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:37.543802 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-e9834659-62a1-42a4-9971-326b549f5c2c admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.151040 May 27 15:12:37.544348 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 36/70] 10.222.0.50 () {60 vars in 1193 bytes} [Fri May 27 15:12:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:12:38.429011 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-f4781a1f-3998-4ab4-bbf0-c2d82fe6d109 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:38.430011 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-f4781a1f-3998-4ab4-bbf0-c2d82fe6d109 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002026 May 27 15:12:38.430406 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 35/71] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 15:12:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:38.621002 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-1b718fb9-934b-426d-b785-d735537c66d2 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:38.622155 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:12:38.622155 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: warnings.warn(msg) May 27 15:12:38.623386 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-1b718fb9-934b-426d-b785-d735537c66d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:38.623820 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-1b718fb9-934b-426d-b785-d735537c66d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:38.624592 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-1b718fb9-934b-426d-b785-d735537c66d2 admin admin] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:38.625012 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-1b718fb9-934b-426d-b785-d735537c66d2 admin admin] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:38.644735 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-1b718fb9-934b-426d-b785-d735537c66d2 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075828 May 27 15:12:38.645205 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 37/72] 10.222.0.50 () {60 vars in 1193 bytes} [Fri May 27 15:12:38 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:12:49.957195 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-f4781a1f-3998-4ab4-bbf0-c2d82fe6d109 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:49.958271 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-f4781a1f-3998-4ab4-bbf0-c2d82fe6d109 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 27 15:12:49.958672 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 36/73] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 15:12:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:50.101988 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_cell0:SELECT=4 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:50.102706 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_cell1:SELECT=4 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:50.103406 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG dbcounter [-] [103305] Writing DB stats nova_api:SELECT=8 {{(pid=103305) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:12:50.151107 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-e09a6a6a-1169-4ca3-a578-331688a36802 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:50.152313 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:12:50.152313 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: warnings.warn(msg) May 27 15:12:50.153514 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-e09a6a6a-1169-4ca3-a578-331688a36802 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:50.153958 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-e09a6a6a-1169-4ca3-a578-331688a36802 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:50.154751 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-e09a6a6a-1169-4ca3-a578-331688a36802 admin admin] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:50.155209 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-e09a6a6a-1169-4ca3-a578-331688a36802 admin admin] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:50.180477 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-e09a6a6a-1169-4ca3-a578-331688a36802 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082785 May 27 15:12:50.181124 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 38/74] 10.222.0.50 () {60 vars in 1193 bytes} [Fri May 27 15:12:50 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:12:51.066816 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-f4781a1f-3998-4ab4-bbf0-c2d82fe6d109 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:51.067953 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-f4781a1f-3998-4ab4-bbf0-c2d82fe6d109 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 May 27 15:12:51.068354 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 37/75] 10.222.0.50 () {56 vars in 1074 bytes} [Fri May 27 15:12:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:12:51.256456 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG nova.api.openstack.wsgi [None req-dd313762-d8c6-4076-b8b8-2661c6a713c0 admin admin] Calling method '>' {{(pid=103305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:12:51.257618 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 15:12:51.257618 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: warnings.warn(msg) May 27 15:12:51.258806 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-dd313762-d8c6-4076-b8b8-2661c6a713c0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:51.259894 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-dd313762-d8c6-4076-b8b8-2661c6a713c0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:51.260698 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-dd313762-d8c6-4076-b8b8-2661c6a713c0 admin admin] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:12:51.261130 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: DEBUG oslo_concurrency.lockutils [None req-dd313762-d8c6-4076-b8b8-2661c6a713c0 admin admin] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:12:51.283222 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: INFO nova.api.openstack.requestlog [None req-dd313762-d8c6-4076-b8b8-2661c6a713c0 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077753 May 27 15:12:51.283770 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: [pid: 103305|app: 0|req: 39/76] 10.222.0.50 () {60 vars in 1193 bytes} [Fri May 27 15:12:51 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:13:51.016217 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: Fri May 27 15:13:51 2022 - graceful shutdown triggered... May 27 15:13:51.015652 dv-cinder-842542-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 27 15:13:51.017275 dv-cinder-842542-2-iscsi devstack@n-api.service[103304]: Gracefully killing worker 1 (pid: 103304)... May 27 15:13:51.017640 dv-cinder-842542-2-iscsi devstack@n-api.service[103305]: Gracefully killing worker 2 (pid: 103305)... May 27 15:13:52.016161 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: worker 1 buried after 1 seconds May 27 15:13:52.016161 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: worker 2 buried after 1 seconds May 27 15:13:52.016161 dv-cinder-842542-2-iscsi devstack@n-api.service[103303]: goodbye to uWSGI. May 27 15:13:52.017770 dv-cinder-842542-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 27 15:13:52.018346 dv-cinder-842542-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 27 15:13:52.021104 dv-cinder-842542-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 27 15:13:52.039478 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 27 15:13:52.061965 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 15:13:52 2022] *** May 27 15:13:52.062153 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 15:13:52.062293 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 15:13:52.062425 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: nodename: dv-cinder-842542-2-iscsi May 27 15:13:52.062622 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: machine: x86_64 May 27 15:13:52.062798 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: clock source: unix May 27 15:13:52.062976 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: pcre jit disabled May 27 15:13:52.063122 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: detected number of CPU cores: 4 May 27 15:13:52.063272 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: current working directory: / May 27 15:13:52.063415 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: detected binary path: /usr/bin/uwsgi-core May 27 15:13:52.063577 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: your processes number limit is 47680 May 27 15:13:52.063724 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: your memory page size is 4096 bytes May 27 15:13:52.063876 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: detected max file descriptor number: 2048 May 27 15:13:52.064031 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: lock engine: pthread robust mutexes May 27 15:13:52.064379 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: thunder lock: enabled May 27 15:13:52.064770 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 27 15:13:52.065643 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 15:13:52.111130 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: Python main interpreter initialized at 0x5577814839c0 May 27 15:13:52.111130 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: python threads support enabled May 27 15:13:52.111130 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: your server socket listen backlog is limited to 100 connections May 27 15:13:52.111130 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: your mercy for graceful operations on workers is 90 seconds May 27 15:13:52.111596 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: mapped 403077 bytes (393 KB) for 2 cores May 27 15:13:52.111596 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: *** Operational MODE: preforking *** May 27 15:13:52.111814 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: *** uWSGI is running in multiple interpreter mode *** May 27 15:13:52.111814 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: spawned uWSGI master process (pid: 117718) May 27 15:13:52.112025 dv-cinder-842542-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 27 15:13:52.112626 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: spawned uWSGI worker 1 (pid: 117742, cores: 1) May 27 15:13:52.113564 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: spawned uWSGI worker 2 (pid: 117743, cores: 1) May 27 15:13:52.113564 dv-cinder-842542-2-iscsi devstack@n-api.service[117718]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 15:13:53.305707 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 15:13:53.306322 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 15:13:54.116325 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 15:13:54.116325 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: from cryptography.utils import int_from_bytes May 27 15:13:54.116654 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 15:13:54.116654 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: from cryptography.utils import int_from_bytes May 27 15:13:54.118149 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 15:13:54.118149 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: from cryptography.utils import int_from_bytes May 27 15:13:54.118495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 15:13:54.118495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: from cryptography.utils import int_from_bytes May 27 15:13:56.583080 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 15:13:56.583776 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 15:13:56.584131 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 15:13:56.584221 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 15:13:56.584316 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 15:13:56.584400 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 15:13:56.584504 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 15:13:56.584615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 15:13:56.584734 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 15:13:56.584825 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 15:13:56.584912 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.585294 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.585396 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.585480 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.585552 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.585745 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.585853 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.586009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.586165 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.586338 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.586450 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.586660 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.586772 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.587015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.587126 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.587345 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.587460 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.587687 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.587793 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.587944 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.588046 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.588271 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.588519 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842542-2-iscsi {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.588675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842542-2-iscsi {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.588818 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.588967 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.589116 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.589268 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.589420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.589570 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.589756 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.589933 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.590086 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.590248 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.590400 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.590543 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.590716 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.590909 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.592393 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.592956 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.593224 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.593435 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.593670 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.593886 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.593886 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.594307 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.594523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.594745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.594974 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.595181 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.595404 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.595623 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.595839 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.596053 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.596267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.596481 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.596703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.596919 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.597125 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.597347 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.597564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842542-2-iscsi {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.597564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.597976 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842542-2-iscsi {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.598161 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.598316 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.598509 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.598654 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.598654 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.599164 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.599164 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.599699 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.600933 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.601105 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.601105 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.601378 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.601522 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.601664 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.601664 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.601957 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.601957 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.602256 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.602256 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.602549 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.602708 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.602895 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.603061 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.603211 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.603363 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.603640 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.603803 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.604122 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.604281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.604425 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.604590 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.604751 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.604903 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.605048 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.605196 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.605339 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.605480 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.605631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.605782 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.605924 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.606074 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.606217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.606377 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.606534 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.606685 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.606841 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.607065 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.607220 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.607381 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.607535 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.607679 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.607830 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.607985 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.608147 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.608302 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.608445 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.608586 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.608727 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.608868 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.609021 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.609174 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.609346 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.609654 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.609810 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.609980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.610663 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.610824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.611020 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.611164 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.611317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.611564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.611725 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.611874 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.612017 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.612158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.612306 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.612456 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.612610 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.612768 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.612921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.612921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.613209 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.613209 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.613488 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.613641 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.613793 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.613934 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.614192 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.614349 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.614499 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.614645 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.614806 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.615008 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.615163 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.615307 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.615447 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.615596 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.615738 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.615887 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.616038 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.616208 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.616856 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.617016 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.617178 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.617333 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.617485 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.617635 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.617777 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.617924 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.618073 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.618278 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.618441 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.618584 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.618725 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.618891 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.619054 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.619220 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.619373 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.619515 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.619819 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.619976 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.620127 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.620856 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.621019 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.621163 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.621310 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.621453 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.621595 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.621750 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.621905 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.622056 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.622200 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.622341 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.622482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.622711 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.623380 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.623543 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.623687 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.623836 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.623986 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.624145 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.624295 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.624454 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.624602 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.624743 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.624994 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.625154 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.625299 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.625440 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.625581 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.625729 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.625881 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.626030 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.626179 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.626334 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.626494 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.626638 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.626792 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.626984 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.627138 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.627821 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.627972 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.628067 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.628067 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.628227 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.628227 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.628367 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.628468 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.628555 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.628555 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.628701 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.628790 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.628886 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.628967 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.629048 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.629129 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.629207 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.629285 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.629364 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.629436 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.629539 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.629625 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.629697 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.629768 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.629838 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.629908 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.629992 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.630071 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.630071 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.630214 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.630291 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.630361 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.630440 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.630555 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.630644 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.630717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.630812 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.630931 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.631022 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.631103 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.631203 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.631289 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.631289 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.631424 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.631504 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.631584 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.631655 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.631732 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.631840 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.631930 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.632011 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.632083 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.632191 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 15:13:56.632191 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.632328 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.632328 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.632501 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.632588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.632672 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.632773 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.632865 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.632954 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.633028 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.633101 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.633216 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.633216 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.633216 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.633449 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.633557 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.633635 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.633713 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.633806 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.633905 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.633985 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.634058 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.634128 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.634204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.634275 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.634364 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.634447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.634560 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.634643 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.634723 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.634795 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.634884 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.634981 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.635063 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.635166 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.635248 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.635328 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.635406 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.636536 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.636697 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.636854 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.637007 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.637159 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.637328 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.637486 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.637629 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.637772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.637913 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.638054 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.638215 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.638366 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.638569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.639261 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.639498 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.639727 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.639978 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.640200 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.640378 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.640378 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.640703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.640849 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.641029 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.641182 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.641355 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.641507 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.641675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.641838 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.642015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.642159 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.642159 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.642159 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.642620 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.642783 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.642974 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.643136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.643287 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.643432 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.643613 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.643777 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.643921 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.644070 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.644248 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.644402 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.644562 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.644805 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.644951 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.645120 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.645287 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.645442 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.645594 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.645773 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.645950 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.646099 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.646277 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.646444 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.646602 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.646745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.646943 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.647095 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.647253 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.647431 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.647584 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.647729 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.647901 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.648058 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.648214 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.648377 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.648542 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.648719 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.648863 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.649040 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.649195 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.649345 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.649501 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.649680 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.649824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.649998 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.650146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.650298 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.650441 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.650618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.650773 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.650942 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.651112 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.651296 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.651454 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.651622 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.651766 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.651932 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.652080 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.652245 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.652245 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.652245 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.652726 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.652872 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.653023 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.653179 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.653345 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.653491 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.653632 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.653773 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.653940 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.654344 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.654665 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.654839 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.655084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.655232 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.655419 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.655595 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.655752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.655922 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.656076 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.656241 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.656398 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.656551 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.656719 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.656888 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.657043 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.657205 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.657364 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.657508 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.657684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.657849 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.658021 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.658189 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.658358 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.658509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.658693 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.658920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.659083 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.659268 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.659428 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.659601 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.659750 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.659922 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.660070 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.660246 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.660398 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.660563 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.660710 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.660852 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.660992 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.661144 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.661329 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.661475 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.661648 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.661801 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.661981 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.662134 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.662300 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.662445 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.662594 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.662737 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.662933 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.663084 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.663084 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.663084 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.663562 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.663710 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.663862 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.664012 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.664162 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.664329 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.664475 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.664649 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.664801 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.664980 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.665126 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.665267 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.665439 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.665619 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.665770 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.665940 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.666090 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.666266 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.666410 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.666584 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.666730 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.666912 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.667065 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.667249 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.667404 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.667598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.667753 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.667928 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.668081 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.668231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.668381 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.668533 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.668699 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.668852 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.669003 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.669152 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.669327 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.669481 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.669637 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.669861 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.670083 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.670269 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.670422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.670564 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.670706 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.670897 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.671083 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.671237 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.671389 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.671539 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.671721 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.671871 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.672037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.672190 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.672367 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.672512 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.672653 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.672795 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.672795 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.672795 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.673207 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.673349 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.673490 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.673650 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.673650 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.673944 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.673944 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.674221 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.674221 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.674498 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.674648 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.674887 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.675044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.675199 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.675342 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.675491 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.675491 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.675787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.675941 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.676090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.676233 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.676373 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.676521 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.676672 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.676822 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.676964 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.677105 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.677245 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.677395 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.677547 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.677696 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.677838 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.677987 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.678130 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.678283 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.678426 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.678426 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.678702 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.678702 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.679002 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.679161 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.679319 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.679319 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.679608 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.679748 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.679889 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.680038 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.680181 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.680329 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.680478 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.680635 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.680787 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.680945 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.681097 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.681257 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.681406 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.681561 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.681723 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.681723 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.682014 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.682163 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.682320 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.682320 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.682320 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.682752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.682920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.682920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.683230 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.683381 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.683543 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.683693 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.683848 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.684005 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.684155 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.684313 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.684471 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.684621 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.685918 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.686189 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.686449 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.686703 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.686931 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.687102 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.687264 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.687435 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.687602 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.687760 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.687945 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.688104 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.688338 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.688500 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.688671 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.688821 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.688979 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.689141 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.689299 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.689455 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.689605 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.689753 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.689909 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.690068 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.690218 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.690366 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.690531 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.690693 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.690841 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.691057 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.691209 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.691367 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.691525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.691683 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.691831 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.691992 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.691992 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.692291 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.692448 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.692596 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.692775 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.692926 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.693073 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.693073 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.693361 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.693518 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.693676 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.693825 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.693973 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.694120 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.694285 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.694445 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.694615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.694785 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.695113 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.695277 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.695435 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.695630 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.695788 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.695937 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.696094 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.696288 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.696443 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.696592 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.696742 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.696905 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.697062 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.697224 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.697397 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.697561 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.697561 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.697881 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.698405 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.698577 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.698729 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.698899 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.699069 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.699228 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.699439 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.699611 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.699773 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.699921 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.700107 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.700259 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.700420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.700571 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.700727 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.700881 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.701093 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.701760 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.701996 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.701996 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.702491 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.702491 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.702949 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.703147 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.703302 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.703458 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.703617 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.703774 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.703919 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.703919 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.703919 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.703919 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.704609 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.704760 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.704902 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.705048 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.705188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.705329 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.705483 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.705623 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.705772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.705912 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.706050 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.706188 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.706413 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.706553 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.706692 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.706830 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.706993 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.707132 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.707286 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.707434 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.707572 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.707710 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.707710 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.707994 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.708142 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.708297 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.708437 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.708583 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.708680 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.708778 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.708872 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.708964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.709048 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.709131 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.709222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.709319 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.709410 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.709530 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.709624 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.709708 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.709800 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.709904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.710020 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.710107 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.710212 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.710314 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.710401 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.710497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.710615 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.710745 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.710946 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.711109 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.711214 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.711421 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.711516 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.711735 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.711839 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.712049 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.712220 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.712359 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.712490 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.712652 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.712785 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.712969 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.713073 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.713286 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.713395 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.713600 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.713702 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.713928 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.714031 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.714246 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.714346 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.714560 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.714660 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.714897 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.715006 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.715217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.715310 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.715526 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.715625 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.715836 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.715936 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.716150 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.716250 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.716458 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.716561 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.716798 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.716965 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.717120 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.717276 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.717692 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.717818 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.717966 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.718060 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.718274 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.718424 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.718585 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.718736 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.718925 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.719034 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.719246 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.719351 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.719554 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.719657 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.719866 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.719966 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.720177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.720269 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.720489 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.720595 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.720819 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.720946 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.721134 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.721235 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.721444 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.721546 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.721753 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.721849 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.722060 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.722161 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.722371 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.722471 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.722696 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.722829 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.723042 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.723139 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.723350 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.723444 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.723665 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.723764 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.723973 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.724065 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.724305 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.724406 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.724616 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.724717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.724927 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.725026 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.725346 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.725461 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.725549 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.725668 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.725849 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.725991 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.726159 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.726304 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.726467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.726585 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.726794 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.727010 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.727138 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.727259 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.727427 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.727556 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.727735 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.727864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.728044 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.728173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.728389 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.728516 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.728695 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.728822 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.729058 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.729177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.729367 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.729487 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.729687 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.729819 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.729997 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.730114 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.730381 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.730535 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.730684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.730947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.731255 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.731373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.731567 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.731707 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.731996 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.732868 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.733006 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.733453 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.733587 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.733829 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.734054 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.734238 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.734370 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.734609 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.734706 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.735001 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.735122 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.735353 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.735455 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.735690 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.735792 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.736022 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.736126 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.736354 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.736447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.736663 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.736757 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.736978 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.737071 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.737297 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.737389 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.737611 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.737703 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.737928 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.738207 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.738301 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.738543 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.738645 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.738867 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.738977 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.739207 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.739320 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.739526 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.739669 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.739844 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.740014 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.740155 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.740344 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.740467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.740684 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.740825 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.741001 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.741118 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.741389 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.741500 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.741701 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.741820 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.742009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.742122 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.742319 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.742423 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.742627 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.742740 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.742967 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.743137 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.743459 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.743594 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.743745 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.743834 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.744017 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.744139 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.744333 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.744446 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.744717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.744879 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.745057 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.745202 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.745375 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.745526 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.745690 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.745831 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.746007 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.746150 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.746300 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.746442 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.746714 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.746896 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.747096 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.747235 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.747412 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.747565 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.747715 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.748479 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.748672 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.748813 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.748966 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.749155 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.749333 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.749536 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.749704 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.749856 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.750023 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.750178 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.750350 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.750497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.750675 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.750833 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.751048 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.751203 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.751379 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.751530 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.751681 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.751828 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.752003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.752146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.752316 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.752510 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.752664 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.752933 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.753108 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.753248 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.753410 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.753566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.753726 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.753871 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.754130 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.754273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.754465 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.754605 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.754762 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.755014 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.755164 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.755309 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.755459 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.755605 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.755762 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.755912 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.756053 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.756196 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.756338 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.756477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.756692 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.756845 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.756997 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.757138 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.757317 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.757471 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.757642 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.757794 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.757942 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.758084 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.758269 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.758422 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.758684 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.758828 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.759056 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.759209 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.759360 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.759511 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.759660 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.759804 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.759953 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.760102 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.760314 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.760467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.760610 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.760755 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.760904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.761046 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.761204 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.761300 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.761512 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.761613 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.761838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.761940 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.762148 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.762252 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.762459 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.762551 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.762769 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.762906 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.763103 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.763246 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.763411 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.763556 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.763750 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.763923 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.764054 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.764415 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.764543 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.764800 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.764897 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.765121 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.765216 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.765448 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.765554 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.765778 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.765932 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.766087 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.766306 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.766408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.766633 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.766733 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.767024 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.767194 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.767334 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.767439 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.767643 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.767746 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.767987 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.768095 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.768297 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.768399 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.768621 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.768723 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.768955 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.769050 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.769290 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.769394 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.769605 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.769699 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.769940 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.770036 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.770269 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.770364 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.770587 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.770681 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.770929 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.771028 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.771260 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.771358 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.771567 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.771721 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.771874 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.772074 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.772175 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.772390 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.772492 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.772742 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.772839 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.773054 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.773147 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.773361 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.773452 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.773729 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.773877 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.773993 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.774087 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.774257 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.774397 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.774582 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.774753 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.774929 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.775160 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.775311 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.775478 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.775696 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.775791 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.776015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.776116 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.776326 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.776435 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.776635 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.776770 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.776979 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.777132 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.777286 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.777494 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.777623 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.777854 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.777948 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.778180 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.778275 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.778497 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.778593 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.778879 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.778976 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.779296 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.779413 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.779714 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.779809 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.780080 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.780549 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.780650 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.780874 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.780969 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.781200 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.781337 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.781537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.781640 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.781891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.781987 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.782203 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.782295 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.782522 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.782622 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.782842 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.782953 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.783185 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.783281 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.783529 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.783872 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.784029 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.784208 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.784433 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.784528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.784852 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.784955 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.785194 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.785392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.785517 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.785840 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.785932 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.786164 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.786384 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.786519 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.786830 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.786981 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.787212 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.787344 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.787563 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.787827 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.787930 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.788234 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.788336 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.788591 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.788769 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.788914 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.789233 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.789325 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.789554 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.789762 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.789864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.790178 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.790298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.790500 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.790820 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.790992 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.791256 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.791366 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.791620 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.791828 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.791995 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.792299 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.792403 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.792666 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.792791 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.792988 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.793347 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.793443 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.793836 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.794005 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.794216 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.794311 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.794556 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.795322 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.795535 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.795824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.796139 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.796326 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.796709 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.796804 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.797089 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.797282 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.797425 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.797743 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.797844 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.798087 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.798241 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.798445 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.798727 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.798829 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.799126 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.799246 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.799487 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.799735 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.799840 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.800184 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.800277 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.800536 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.800703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.800910 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.801380 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.801489 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.801710 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.801844 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.802186 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.802290 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.802518 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.802668 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.802890 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.803190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.803308 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.803532 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.803867 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.803989 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.804187 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.804465 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.804572 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.804828 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.804979 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.805142 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.805454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.805593 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.805764 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.806003 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.806148 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.806379 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.806500 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.806687 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.807020 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.807132 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.807334 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.807525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.807664 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.807974 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.808076 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.808283 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.808454 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.808590 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.808905 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.809015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.809212 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.809395 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.809558 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.809870 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.809993 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.810242 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.810488 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.811302 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.811564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.811867 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.812117 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.812263 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.812569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.812689 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.812958 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.813237 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.813346 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.813645 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.814023 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.814262 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.814387 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.814737 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.814931 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.815115 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.815446 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.815558 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.815801 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.816086 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.816203 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.816514 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.816679 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.816858 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.817317 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.817468 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.817644 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.817981 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.818075 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.818302 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.818619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.818968 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.819076 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.819292 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.819608 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.819703 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.819921 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.820188 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.820283 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.820546 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.820788 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.820891 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.821162 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.821392 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.821495 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.821790 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.821947 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.822103 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.822415 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.822510 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.822726 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.823068 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.823164 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.823381 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.823690 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.823785 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.824006 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.824271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.824400 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.824620 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.824825 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.824937 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.825224 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.825390 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.825530 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.825847 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.826050 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.826209 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.826529 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.826632 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.827010 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.827132 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.827350 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.827599 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.827695 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.827964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.828151 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.828291 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.828620 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.828851 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.829015 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.829376 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.829470 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.829735 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.829839 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.830059 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.830347 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.830441 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.830905 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.831240 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.831622 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.831834 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.832010 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.832177 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.832382 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.832508 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.832753 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.832858 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.833136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.833237 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.833448 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.833554 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.833778 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.833880 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.834096 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.834217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.834424 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.834526 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.834741 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.834885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.835089 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.835203 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.835405 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.835547 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.835720 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.835898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.836036 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.836346 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.836461 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.836658 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.836752 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.836970 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.837073 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.837285 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.837407 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.837597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.837728 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.837909 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.838110 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.838213 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.838482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.838585 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.838826 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.838941 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.839193 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.839288 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.839520 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.839614 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.839843 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.839935 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.840164 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.840266 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.840484 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.840611 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.840801 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.840950 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.841115 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.841298 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.841430 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.841733 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.841893 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.842190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.842292 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.842790 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.843050 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.843217 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.843373 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.843533 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.843684 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.843850 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.844035 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.844226 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.844389 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.844486 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.844760 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.844921 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.845095 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.845260 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.845421 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.845566 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.845715 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.845859 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.846030 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.846175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.846347 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.846511 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.846651 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.846791 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.847004 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.847156 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.847349 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.847488 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.847683 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.847822 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.848011 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.848161 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.848304 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.848447 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.848616 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.848799 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.848938 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.849104 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.849248 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.849453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.849595 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.849803 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.849906 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.850152 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.850247 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.850453 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.850553 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.850766 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.850896 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.851102 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.851273 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.851421 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.851576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.851721 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.851952 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.852107 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.852291 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.852434 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.852578 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.852727 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.852888 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.853039 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.853190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.853343 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.853496 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.853701 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.853866 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.854754 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.855002 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.855002 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.855409 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.855574 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.855722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.855876 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.856035 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.856181 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.856337 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.856655 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.856816 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.856965 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.856965 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.858058 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.858431 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.858736 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.858919 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.858919 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.859192 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.859345 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.859496 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.859642 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.859642 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.859922 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.860066 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.860208 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.860362 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.860507 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.860658 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.860801 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.860953 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.861104 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.861255 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.861407 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.861553 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.861553 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.861824 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.861975 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.862124 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.862227 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.862316 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.862402 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.862489 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.862583 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.862678 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.862774 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.862939 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.863084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.863304 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.863399 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.863648 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.863761 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.863985 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.864086 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.864314 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.864408 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.864637 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.864795 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.864954 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.865062 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.865289 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.865408 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.865606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.865723 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.865915 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.866018 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.866237 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.866340 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.866555 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.866672 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.866897 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.867005 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.867220 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.867330 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.867541 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.867643 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.867862 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.867957 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.868113 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117742) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 15:13:56.868219 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.868487 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.868817 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.869148 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.869498 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.869814 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.870163 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.870495 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.870813 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.871149 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.871458 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 15:13:56.871706 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117743) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 15:13:56.931178 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO dbcounter [None req-d5f93223-b0a8-4d13-8cc3-f82098795c1a None None] Registered counter for database nova_api May 27 15:13:56.934833 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO dbcounter [None req-4e46d8fe-0664-419f-a6fb-35c8b6bf7824 None None] Registered counter for database nova_api May 27 15:13:56.954458 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_db.sqlalchemy.engines [None req-d5f93223-b0a8-4d13-8cc3-f82098795c1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117742) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:13:56.957492 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_db.sqlalchemy.engines [None req-4e46d8fe-0664-419f-a6fb-35c8b6bf7824 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117743) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:13:56.962651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writer thread running {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:13:56.965123 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writer thread running {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:13:57.023432 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.context [None req-4e46d8fe-0664-419f-a6fb-35c8b6bf7824 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),73a26acb-fd81-476d-b23a-413b6c7fb5a6(cell1) {{(pid=117743) load_cells /opt/stack/nova/nova/context.py:464}} May 27 15:13:57.026140 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.context [None req-d5f93223-b0a8-4d13-8cc3-f82098795c1a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),73a26acb-fd81-476d-b23a-413b6c7fb5a6(cell1) {{(pid=117742) load_cells /opt/stack/nova/nova/context.py:464}} May 27 15:13:57.027442 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4e46d8fe-0664-419f-a6fb-35c8b6bf7824 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:57.029412 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4e46d8fe-0664-419f-a6fb-35c8b6bf7824 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:57.030238 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4e46d8fe-0664-419f-a6fb-35c8b6bf7824 None None] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:57.031098 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d5f93223-b0a8-4d13-8cc3-f82098795c1a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:57.032431 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4e46d8fe-0664-419f-a6fb-35c8b6bf7824 None None] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:57.032812 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d5f93223-b0a8-4d13-8cc3-f82098795c1a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:57.033677 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d5f93223-b0a8-4d13-8cc3-f82098795c1a None None] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:13:57.034533 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO dbcounter [None req-4e46d8fe-0664-419f-a6fb-35c8b6bf7824 None None] Registered counter for database nova_cell0 May 27 15:13:57.036016 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d5f93223-b0a8-4d13-8cc3-f82098795c1a None None] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:13:57.038135 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO dbcounter [None req-d5f93223-b0a8-4d13-8cc3-f82098795c1a None None] Registered counter for database nova_cell0 May 27 15:13:57.038602 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO dbcounter [None req-4e46d8fe-0664-419f-a6fb-35c8b6bf7824 None None] Registered counter for database nova_cell1 May 27 15:13:57.042618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO dbcounter [None req-d5f93223-b0a8-4d13-8cc3-f82098795c1a None None] Registered counter for database nova_cell1 May 27 15:13:57.046205 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_db.sqlalchemy.engines [None req-4e46d8fe-0664-419f-a6fb-35c8b6bf7824 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117743) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:13:57.048256 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_db.sqlalchemy.engines [None req-4e46d8fe-0664-419f-a6fb-35c8b6bf7824 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117743) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:13:57.050320 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_db.sqlalchemy.engines [None req-d5f93223-b0a8-4d13-8cc3-f82098795c1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117742) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:13:57.052705 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_db.sqlalchemy.engines [None req-d5f93223-b0a8-4d13-8cc3-f82098795c1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117742) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:13:57.055498 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writer thread running {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:13:57.057564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writer thread running {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:13:57.058396 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writer thread running {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:13:57.060536 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writer thread running {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:13:57.211824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO dbcounter [None req-4e46d8fe-0664-419f-a6fb-35c8b6bf7824 None None] Registered counter for database nova_cell0 May 27 15:13:57.224727 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_db.sqlalchemy.engines [None req-4e46d8fe-0664-419f-a6fb-35c8b6bf7824 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117743) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:13:57.224959 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO dbcounter [None req-d5f93223-b0a8-4d13-8cc3-f82098795c1a None None] Registered counter for database nova_cell0 May 27 15:13:57.229866 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writer thread running {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:13:57.236987 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_db.sqlalchemy.engines [None req-d5f93223-b0a8-4d13-8cc3-f82098795c1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117742) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 15:13:57.242723 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writer thread running {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 15:13:57.555318 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: WARNING keystonemiddleware.auth_token [None req-4e46d8fe-0664-419f-a6fb-35c8b6bf7824 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 15:13:57.562665 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: WARNING keystonemiddleware.auth_token [None req-4e46d8fe-0664-419f-a6fb-35c8b6bf7824 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 15:13:57.566888 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: WARNING keystonemiddleware.auth_token [None req-d5f93223-b0a8-4d13-8cc3-f82098795c1a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 15:13:57.574725 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: WARNING keystonemiddleware.auth_token [None req-d5f93223-b0a8-4d13-8cc3-f82098795c1a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 15:13:57.908076 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: WARNING keystonemiddleware.auth_token [None req-4e46d8fe-0664-419f-a6fb-35c8b6bf7824 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 15:13:57.914082 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: WARNING keystonemiddleware.auth_token [None req-4e46d8fe-0664-419f-a6fb-35c8b6bf7824 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 15:13:57.919420 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5577814839c0 pid: 117743 (default app) May 27 15:13:57.927210 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: WARNING keystonemiddleware.auth_token [None req-d5f93223-b0a8-4d13-8cc3-f82098795c1a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 15:13:57.933282 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: WARNING keystonemiddleware.auth_token [None req-d5f93223-b0a8-4d13-8cc3-f82098795c1a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 15:13:57.939201 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5577814839c0 pid: 117742 (default app) May 27 15:14:39.883463 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_api:SELECT=3 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:39.885182 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=3 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:39.886521 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=3 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:39.887500 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=3 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:40.562450 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=3 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:40.564302 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=3 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:40.565555 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=3 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:40.567921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=3 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:41.364133 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-e5bdcd91-2981-4e25-bb8a-30ed0738d299 tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Action: 'create', calling method: .version_select at 0x7f57e391ec10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-983415569"}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:41.679561 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-16d00e9e-473f-4143-99fd-786adc7e15aa tempest-VolumesGetTestJSON-160396542 tempest-VolumesGetTestJSON-160396542-project] Action: 'create', calling method: .version_select at 0x7f57e391ec10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1615610898", "metadata": {"Type": "work"}}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:42.842126 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-e5bdcd91-2981-4e25-bb8a-30ed0738d299 tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.963463 May 27 15:14:42.847884 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 1/1] 10.222.0.50 () {60 vars in 1154 bytes} [Fri May 27 15:14:39 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2970 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 27 15:14:42.945151 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-16d00e9e-473f-4143-99fd-786adc7e15aa tempest-VolumesGetTestJSON-160396542 tempest-VolumesGetTestJSON-160396542-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.387985 May 27 15:14:42.945814 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 1/2] 10.222.0.50 () {60 vars in 1155 bytes} [Fri May 27 15:14:40 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2390 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 27 15:14:42.952729 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f06195e1-80e9-4037-beaf-369d4460fefa tempest-VolumesTestJSON-814338443 tempest-VolumesTestJSON-814338443-project] Calling method '.version_select at 0x7f57e376bb80>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:43.052262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f06195e1-80e9-4037-beaf-369d4460fefa tempest-VolumesTestJSON-814338443 tempest-VolumesTestJSON-814338443-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/59c90bd1-5174-4e46-b4f7-c28038b20e21" status: 200 len: 349 microversion: 2.1 time: 0.105191 May 27 15:14:43.053385 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 2/3] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 15:14:42 2022] GET /compute/v2.1/os-volumes/59c90bd1-5174-4e46-b4f7-c28038b20e21 => generated 349 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:43.058498 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ab4898b1-6a9e-4968-836f-ea1d7930900c tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Calling method '.version_select at 0x7f57e376bd30>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:43.258001 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-71289b0e-48ee-4e62-ad8f-44b866f8a02e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-738410732", "imageRef": "a9407644-1f68-43e6-beb1-ce2085766180", "flavorRef": "452", "networks": [{"uuid": "10f99e68-f247-4752-aa9f-59bd2944382a"}]}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:43.457824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.network.neutron [None req-71289b0e-48ee-4e62-ad8f-44b866f8a02e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] validate_networks() for [('10f99e68-f247-4752-aa9f-59bd2944382a', None, None, None, None, None)] {{(pid=117743) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:14:43.520096 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ab4898b1-6a9e-4968-836f-ea1d7930900c tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/68f4086c-afce-4001-83fc-4af5abc4d196" status: 200 len: 345 microversion: 2.1 time: 0.465411 May 27 15:14:43.520712 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 3/4] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 15:14:43 2022] GET /compute/v2.1/os-volumes/68f4086c-afce-4001-83fc-4af5abc4d196 => generated 345 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:43.526231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-d64f651f-3ccb-48cd-8939-c046935c4b4e tempest-VolumesGetTestJSON-160396542 tempest-VolumesGetTestJSON-160396542-project] Calling method '.version_select at 0x7f57e377f430>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:43.706028 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-d64f651f-3ccb-48cd-8939-c046935c4b4e tempest-VolumesGetTestJSON-160396542 tempest-VolumesGetTestJSON-160396542-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/433143e8-fd31-41b0-93c2-04c08209734e" status: 200 len: 354 microversion: 2.1 time: 0.183554 May 27 15:14:43.706625 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 4/5] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 15:14:43 2022] GET /compute/v2.1/os-volumes/433143e8-fd31-41b0-93c2-04c08209734e => generated 354 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:43.711476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-aa75f07a-81e4-46a7-821a-99751358385d tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Action: 'create', calling method: .version_select at 0x7f57e377fa60>, body: {"snapshot": {"volume_id": "68f4086c-afce-4001-83fc-4af5abc4d196", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-362759788"}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:44.137757 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-aa75f07a-81e4-46a7-821a-99751358385d tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] 10.222.0.50 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.429190 May 27 15:14:44.139006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 5/6] 10.222.0.50 () {60 vars in 1161 bytes} [Fri May 27 15:14:43 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:44.150059 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b28501a9-280c-466a-8083-0cf9f9c8309f tempest-VolumesGetTestJSON-160396542 tempest-VolumesGetTestJSON-160396542-project] Calling method '.version_select at 0x7f57e377fdc0>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:44.278956 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b28501a9-280c-466a-8083-0cf9f9c8309f tempest-VolumesGetTestJSON-160396542 tempest-VolumesGetTestJSON-160396542-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/433143e8-fd31-41b0-93c2-04c08209734e" status: 200 len: 354 microversion: 2.1 time: 0.138045 May 27 15:14:44.280908 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 6/7] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 15:14:44 2022] GET /compute/v2.1/os-volumes/433143e8-fd31-41b0-93c2-04c08209734e => generated 354 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:44.288526 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ce95f847-27ee-490e-9c1d-2d97c1b461b8 tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Calling method '.version_select at 0x7f57e377f5e0>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:44.354839 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ce95f847-27ee-490e-9c1d-2d97c1b461b8 tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09" status: 200 len: 286 microversion: 2.1 time: 0.072627 May 27 15:14:44.357109 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 7/8] 10.222.0.50 () {58 vars in 1250 bytes} [Fri May 27 15:14:44 2022] GET /compute/v2.1/os-snapshots/eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:44.362981 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f055a020-7bd3-4d13-bfc5-7f75efb4239e tempest-VolumesGetTestJSON-160396542 tempest-VolumesGetTestJSON-160396542-project] Calling method '.version_select at 0x7f57e376bc10>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:44.514504 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f055a020-7bd3-4d13-bfc5-7f75efb4239e tempest-VolumesGetTestJSON-160396542 tempest-VolumesGetTestJSON-160396542-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/433143e8-fd31-41b0-93c2-04c08209734e" status: 202 len: 0 microversion: 2.1 time: 0.156041 May 27 15:14:44.515875 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 8/9] 10.222.0.50 () {58 vars in 1247 bytes} [Fri May 27 15:14:44 2022] DELETE /compute/v2.1/os-volumes/433143e8-fd31-41b0-93c2-04c08209734e => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:14:44.520945 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-d31fe3e4-abc9-4a5d-9579-b0ba7ecbaeb9 tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Calling method '.version_select at 0x7f57e376bca0>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:44.621568 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-d31fe3e4-abc9-4a5d-9579-b0ba7ecbaeb9 tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.104127 May 27 15:14:44.660807 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 9/10] 10.222.0.50 () {58 vars in 1139 bytes} [Fri May 27 15:14:44 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:44.660807 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-078c48f3-dc7b-4eef-b3d8-b41c45cf3a53 tempest-VolumesGetTestJSON-160396542 tempest-VolumesGetTestJSON-160396542-project] Calling method '.version_select at 0x7f57e377f8b0>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:44.816219 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-078c48f3-dc7b-4eef-b3d8-b41c45cf3a53 tempest-VolumesGetTestJSON-160396542 tempest-VolumesGetTestJSON-160396542-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/433143e8-fd31-41b0-93c2-04c08209734e" status: 200 len: 353 microversion: 2.1 time: 0.190610 May 27 15:14:44.817876 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 10/11] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 15:14:44 2022] GET /compute/v2.1/os-volumes/433143e8-fd31-41b0-93c2-04c08209734e => generated 353 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:44.825471 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8b6a495c-c781-4244-94d3-7c4694815ef6 tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Calling method '.version_select at 0x7f57e378c0d0>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:44.867382 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-8b6a495c-c781-4244-94d3-7c4694815ef6 tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09" status: 200 len: 286 microversion: 2.1 time: 0.048205 May 27 15:14:44.868496 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 11/12] 10.222.0.50 () {58 vars in 1250 bytes} [Fri May 27 15:14:44 2022] GET /compute/v2.1/os-snapshots/eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:44.873905 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f284da0e-414f-458a-ae7b-1d336b834f1d tempest-VolumesTestJSON-814338443 tempest-VolumesTestJSON-814338443-project] Calling method '.version_select at 0x7f57e377fdc0>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:44.928930 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-71289b0e-48ee-4e62-ad8f-44b866f8a02e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Flavor limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:14:44.929457 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-71289b0e-48ee-4e62-ad8f-44b866f8a02e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Image limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:14:44.930006 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-71289b0e-48ee-4e62-ad8f-44b866f8a02e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Flavor pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:14:44.930611 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-71289b0e-48ee-4e62-ad8f-44b866f8a02e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Image pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:14:44.931252 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-71289b0e-48ee-4e62-ad8f-44b866f8a02e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:14:44.943569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f284da0e-414f-458a-ae7b-1d336b834f1d tempest-VolumesTestJSON-814338443 tempest-VolumesTestJSON-814338443-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/4988244a-8293-4bde-8536-b87b16079b3a" status: 200 len: 351 microversion: 2.1 time: 0.073822 May 27 15:14:44.944263 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 12/13] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 15:14:44 2022] GET /compute/v2.1/os-volumes/4988244a-8293-4bde-8536-b87b16079b3a => generated 351 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:44.963969 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-71289b0e-48ee-4e62-ad8f-44b866f8a02e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:44.964430 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-71289b0e-48ee-4e62-ad8f-44b866f8a02e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:44.965881 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-71289b0e-48ee-4e62-ad8f-44b866f8a02e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:44.966325 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-71289b0e-48ee-4e62-ad8f-44b866f8a02e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:45.029981 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-71289b0e-48ee-4e62-ad8f-44b866f8a02e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Getting quotas for project d624b45721514810b49fbbd38c7afb5c. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:14:45.047063 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-71289b0e-48ee-4e62-ad8f-44b866f8a02e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Getting quotas for user 92e368db026e4a8f8f4730710471868b and project d624b45721514810b49fbbd38c7afb5c. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:14:45.083368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-71289b0e-48ee-4e62-ad8f-44b866f8a02e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Going to run 1 instances... {{(pid=117743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:14:45.086286 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-71289b0e-48ee-4e62-ad8f-44b866f8a02e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9407644-1f68-43e6-beb1-ce2085766180',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:14:45.258492 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-71289b0e-48ee-4e62-ad8f-44b866f8a02e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.408042 May 27 15:14:45.259541 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 2/14] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 15:14:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:14:45.269994 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b0f68e41-3cf9-4250-9bf5-99a8b19ce0f8 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:45.271055 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b0f68e41-3cf9-4250-9bf5-99a8b19ce0f8 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:45.581046 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b0f68e41-3cf9-4250-9bf5-99a8b19ce0f8 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:45.603427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b0f68e41-3cf9-4250-9bf5-99a8b19ce0f8 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1214 microversion: 2.1 time: 0.337245 May 27 15:14:45.606479 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 13/15] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:14:45 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1214 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:45.833702 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a67c0573-0d63-478a-bfad-6ea2524fc4dc tempest-VolumesGetTestJSON-160396542 tempest-VolumesGetTestJSON-160396542-project] Calling method '.version_select at 0x7f57e2e81700>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:45.882948 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-fd0f9c7f-f99d-4cf2-882e-9b09879d27fa tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Calling method '.version_select at 0x7f57e378c4c0>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:45.945306 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-fd0f9c7f-f99d-4cf2-882e-9b09879d27fa tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09" status: 200 len: 286 microversion: 2.1 time: 0.068072 May 27 15:14:45.945684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a67c0573-0d63-478a-bfad-6ea2524fc4dc tempest-VolumesGetTestJSON-160396542 tempest-VolumesGetTestJSON-160396542-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/433143e8-fd31-41b0-93c2-04c08209734e" status: 200 len: 353 microversion: 2.1 time: 0.118436 May 27 15:14:45.946204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 14/16] 10.222.0.50 () {58 vars in 1250 bytes} [Fri May 27 15:14:45 2022] GET /compute/v2.1/os-snapshots/eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:45.950966 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 3/17] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 15:14:45 2022] GET /compute/v2.1/os-volumes/433143e8-fd31-41b0-93c2-04c08209734e => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:46.623606 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-9f8edd5a-d54f-4880-8f91-0c47919fa72b tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:46.623606 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-9f8edd5a-d54f-4880-8f91-0c47919fa72b tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:46.928904 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-9f8edd5a-d54f-4880-8f91-0c47919fa72b tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:46.940663 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-9f8edd5a-d54f-4880-8f91-0c47919fa72b tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1214 microversion: 2.1 time: 0.318855 May 27 15:14:46.941307 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 15/18] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:14:46 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1214 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:46.959841 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-aa26b80b-857d-4134-ba97-6b4d0dc6ab03 tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Calling method '.version_select at 0x7f57e2e81e50>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:46.963887 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-716abbb1-3c75-4cc2-8f89-3cef73f25ca0 tempest-VolumesGetTestJSON-160396542 tempest-VolumesGetTestJSON-160396542-project] Calling method '.version_select at 0x7f57e3749dc0>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:47.085714 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-716abbb1-3c75-4cc2-8f89-3cef73f25ca0 tempest-VolumesGetTestJSON-160396542 tempest-VolumesGetTestJSON-160396542-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/433143e8-fd31-41b0-93c2-04c08209734e" status: 200 len: 353 microversion: 2.1 time: 0.126580 May 27 15:14:47.086674 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 16/19] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 15:14:46 2022] GET /compute/v2.1/os-volumes/433143e8-fd31-41b0-93c2-04c08209734e => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:14:47.092223 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-aa26b80b-857d-4134-ba97-6b4d0dc6ab03 tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09" status: 200 len: 286 microversion: 2.1 time: 0.137412 May 27 15:14:47.095558 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 4/20] 10.222.0.50 () {58 vars in 1250 bytes} [Fri May 27 15:14:46 2022] GET /compute/v2.1/os-snapshots/eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:47.958272 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-4fe27143-84fc-48b9-aaff-c937632a85c0 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:47.959095 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-4fe27143-84fc-48b9-aaff-c937632a85c0 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:47.970159 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4fe27143-84fc-48b9-aaff-c937632a85c0 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:47.971089 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4fe27143-84fc-48b9-aaff-c937632a85c0 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:47.974760 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4fe27143-84fc-48b9-aaff-c937632a85c0 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:47.975619 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4fe27143-84fc-48b9-aaff-c937632a85c0 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:48.099560 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-75622c38-1913-4507-b491-f449bd442bfc tempest-VolumesGetTestJSON-160396542 tempest-VolumesGetTestJSON-160396542-project] Calling method '.version_select at 0x7f57e2e81b80>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:48.223141 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-75622c38-1913-4507-b491-f449bd442bfc tempest-VolumesGetTestJSON-160396542 tempest-VolumesGetTestJSON-160396542-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/433143e8-fd31-41b0-93c2-04c08209734e" status: 200 len: 353 microversion: 2.1 time: 0.127347 May 27 15:14:48.224214 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 5/21] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 15:14:48 2022] GET /compute/v2.1/os-volumes/433143e8-fd31-41b0-93c2-04c08209734e => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:48.229052 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-ef4ab85f-2370-4a9a-94c0-4be474d52759 tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Calling method '.version_select at 0x7f57e2e811f0>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:48.272438 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-ef4ab85f-2370-4a9a-94c0-4be474d52759 tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09" status: 200 len: 287 microversion: 2.1 time: 0.046876 May 27 15:14:48.278754 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-4fe27143-84fc-48b9-aaff-c937632a85c0 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:48.279759 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 6/22] 10.222.0.50 () {58 vars in 1250 bytes} [Fri May 27 15:14:48 2022] GET /compute/v2.1/os-snapshots/eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:48.285199 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-7d2306d6-fa6e-49c6-9190-d9a2d036aaaa tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Calling method '.version_select at 0x7f57e261f310>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:48.296206 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-4fe27143-84fc-48b9-aaff-c937632a85c0 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1266 microversion: 2.1 time: 0.342180 May 27 15:14:48.298270 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 17/23] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:14:47 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1266 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:48.368295 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-7d2306d6-fa6e-49c6-9190-d9a2d036aaaa tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] 10.222.0.50 "DELETE /compute/v2.1/os-snapshots/eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09" status: 202 len: 0 microversion: 2.1 time: 0.087129 May 27 15:14:48.373101 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 7/24] 10.222.0.50 () {58 vars in 1253 bytes} [Fri May 27 15:14:48 2022] DELETE /compute/v2.1/os-snapshots/eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:14:48.378493 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-51435087-eb2f-4d60-8913-4f72d6a0b99a tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Calling method '.version_select at 0x7f57e367e3a0>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:48.416774 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-51435087-eb2f-4d60-8913-4f72d6a0b99a tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09" status: 200 len: 286 microversion: 2.1 time: 0.042364 May 27 15:14:48.420015 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 18/25] 10.222.0.50 () {58 vars in 1250 bytes} [Fri May 27 15:14:48 2022] GET /compute/v2.1/os-snapshots/eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:14:49.084771 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-3dbef01a-6039-4c4d-9092-5501aa7c27bd tempest-VolumesTestJSON-814338443 tempest-VolumesTestJSON-814338443-project] Calling method '.version_select at 0x7f57e2e81280>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:49.237323 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-10802ed9-814f-4e6f-8ce6-3350fc974766 tempest-VolumesGetTestJSON-160396542 tempest-VolumesGetTestJSON-160396542-project] Calling method '.version_select at 0x7f57e368d700>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:49.262275 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-3dbef01a-6039-4c4d-9092-5501aa7c27bd tempest-VolumesTestJSON-814338443 tempest-VolumesTestJSON-814338443-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/85fa49e2-11ef-4390-a0c2-b9366c21fd2e" status: 200 len: 351 microversion: 2.1 time: 0.182344 May 27 15:14:49.263813 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 8/26] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 15:14:49 2022] GET /compute/v2.1/os-volumes/85fa49e2-11ef-4390-a0c2-b9366c21fd2e => generated 351 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:49.276829 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-3a44ac0d-022a-423c-a222-cfcb12ecf52b tempest-VolumesTestJSON-814338443 tempest-VolumesTestJSON-814338443-project] Calling method '.version_select at 0x7f57e2e81c10>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:49.323201 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-10802ed9-814f-4e6f-8ce6-3350fc974766 tempest-VolumesGetTestJSON-160396542 tempest-VolumesGetTestJSON-160396542-project] HTTP exception thrown: Volume 433143e8-fd31-41b0-93c2-04c08209734e could not be found. May 27 15:14:49.328831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-10802ed9-814f-4e6f-8ce6-3350fc974766 tempest-VolumesGetTestJSON-160396542 tempest-VolumesGetTestJSON-160396542-project] Request method failure captured: May 27 15:14:49.328831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/os-volumes/433143e8-fd31-41b0-93c2-04c08209734e HTTP/1.1 May 27 15:14:49.328831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:14:49.328831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:14:49.328831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:14:49.328831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:14:49.328831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:14:49.328831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:14:49.328831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:14:49.328831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:14:49.328831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOrg8bWWwVjc82_grUegGnalvgbq_22SEy041aoAJcCSiA_HkMf3_1OWa1Sip26HiiEZ78qnyRILvli5oq-Rl_YC7CqHfPmP5L0UpFDmUxTwX3i6cjMloRcVExkol4mUM29txPRNKk0uNWI2V3CFVGOpA0x4Ji5GjaR9yi-iy326Qcc May 27 15:14:49.328831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:14:49.328831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:14:49.328831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:14:49.328831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:14:49.328831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:14:49.328831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:14:49.328831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: efb8b11b65d04ce5a16afcc8ab579931 May 27 15:14:49.328831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-VolumesGetTestJSON-160396542 May 27 15:14:49.328831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:14:49.328831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:14:49.329827 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/efb8b11b65d04ce5a16afcc8ab579931"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_efb8b11b65d04ce5a16afcc8ab579931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/efb8b11b65d04ce5a16afcc8ab579931"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/efb8b11b65d04ce5a16afcc8ab579931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:14:49.329827 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-VolumesGetTestJSON-160396542 May 27 15:14:49.329827 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: efb8b11b65d04ce5a16afcc8ab579931 May 27 15:14:49.329827 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-VolumesGetTestJSON-160396542 May 27 15:14:49.329827 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-VolumesGetTestJSON-160396542-project May 27 15:14:49.329827 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:14:49.329827 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:14:49.329827 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 5148faabb9414eeca471f00591eb167d May 27 15:14:49.329827 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-VolumesGetTestJSON-160396542-project May 27 15:14:49.329827 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: May 27 15:14:49.329827 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Volume 433143e8-fd31-41b0-93c2-04c08209734e could not be found. May 27 15:14:49.329827 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': '433143e8-fd31-41b0-93c2-04c08209734e'} May 27 15:14:49.329827 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:14:49.330454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:49.330454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:14:49.330454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:14:49.330454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:14:49.330454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:14:49.330454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:14:49.330454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:14:49.330454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:14:49.330454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:14:49.330454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:14:49.330454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:14:49.330454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:14:49.330454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:14:49.330454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:14:49.330454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:14:49.330454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 433143e8-fd31-41b0-93c2-04c08209734e could not be found. (HTTP 404) (Request-ID: req-d8a2a14f-02fb-4a23-b613-4f286a26d03b) May 27 15:14:49.330454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:49.330454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:14:49.330454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:49.331391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:49.331391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 15:14:49.331391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 15:14:49.331391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:14:49.331391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:14:49.331391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 15:14:49.331391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 15:14:49.331391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:14:49.331391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:14:49.331391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:14:49.331391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:14:49.331391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:14:49.331391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:14:49.331391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:14:49.331391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:14:49.331391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:14:49.331391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:14:49.331391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:14:49.331391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:14:49.332915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:14:49.332915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:14:49.332915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:14:49.332915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:14:49.332915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 433143e8-fd31-41b0-93c2-04c08209734e could not be found. May 27 15:14:49.332915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:49.332915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:14:49.332915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:49.332915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:49.332915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:14:49.332915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:14:49.332915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:14:49.332915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:14:49.332915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:14:49.332915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:14:49.332915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:14:49.332915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:14:49.332915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 15:14:49.332915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:14:49.334734 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 433143e8-fd31-41b0-93c2-04c08209734e could not be found. May 27 15:14:49.334734 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:49.334734 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:14:49.334734 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:49.334734 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:49.334734 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:14:49.334734 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:14:49.334734 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:14:49.334734 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:14:49.334734 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 433143e8-fd31-41b0-93c2-04c08209734e could not be found. May 27 15:14:49.334734 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:49.334734 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-10802ed9-814f-4e6f-8ce6-3350fc974766 tempest-VolumesGetTestJSON-160396542 tempest-VolumesGetTestJSON-160396542-project] Returning 404 to user: Volume 433143e8-fd31-41b0-93c2-04c08209734e could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:14:49.334734 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-10802ed9-814f-4e6f-8ce6-3350fc974766 tempest-VolumesGetTestJSON-160396542 tempest-VolumesGetTestJSON-160396542-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/433143e8-fd31-41b0-93c2-04c08209734e" status: 404 len: 109 microversion: 2.1 time: 0.098029 May 27 15:14:49.336856 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 19/27] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 15:14:49 2022] GET /compute/v2.1/os-volumes/433143e8-fd31-41b0-93c2-04c08209734e => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:14:49.365844 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-92a861ec-e2d1-4736-b520-12d4f865a325 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:49.373956 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-92a861ec-e2d1-4736-b520-12d4f865a325 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:49.398792 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-92a861ec-e2d1-4736-b520-12d4f865a325 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:49.402437 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-92a861ec-e2d1-4736-b520-12d4f865a325 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:49.406105 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-92a861ec-e2d1-4736-b520-12d4f865a325 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:49.411609 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-92a861ec-e2d1-4736-b520-12d4f865a325 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:49.603750 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-3a44ac0d-022a-423c-a222-cfcb12ecf52b tempest-VolumesTestJSON-814338443 tempest-VolumesTestJSON-814338443-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.331919 May 27 15:14:49.604602 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 9/28] 10.222.0.50 () {58 vars in 1133 bytes} [Fri May 27 15:14:49 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:49.614121 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-934474e5-9667-4378-8940-d7a68de32366 tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Calling method '.version_select at 0x7f57e261f040>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:49.663624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-934474e5-9667-4378-8940-d7a68de32366 tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] HTTP exception thrown: Snapshot eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09 could not be found. May 27 15:14:49.669298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-934474e5-9667-4378-8940-d7a68de32366 tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Request method failure captured: May 27 15:14:49.669298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: GET /compute/v2.1/os-snapshots/eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09 HTTP/1.1 May 27 15:14:49.669298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:14:49.669298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:14:49.669298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:14:49.669298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 0 May 27 15:14:49.669298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:14:49.669298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:14:49.669298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:14:49.669298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:14:49.669298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOrfXBCseXfcaz0YL164_ICLVtomjVE5J9WbDtTa0ahfa6DM0BPHEybgxFwPv7Scl4wJQ9LqUnFE9OSDnx4Wjc9z04QzDQlRKoomg59TKEXme0ssfKriySJaCkPTlF-S00vrIFSXoUa9ONVZ6j3gGuaZCOdlrDp1RNq2BxFpqjTOSl8 May 27 15:14:49.669298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:14:49.669298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:14:49.669298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:14:49.669298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:14:49.669298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:14:49.669298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:14:49.669298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: d3a001740e9e476c9cee17b42c1c7816 May 27 15:14:49.669298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-348655424 May 27 15:14:49.669298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:14:49.669298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:14:49.670418 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3a001740e9e476c9cee17b42c1c7816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d3a001740e9e476c9cee17b42c1c7816"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3a001740e9e476c9cee17b42c1c7816"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d3a001740e9e476c9cee17b42c1c7816"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:14:49.670418 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-VolumesSnapshotsTestJSON-348655424 May 27 15:14:49.670418 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: d3a001740e9e476c9cee17b42c1c7816 May 27 15:14:49.670418 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-348655424 May 27 15:14:49.670418 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-VolumesSnapshotsTestJSON-348655424-project May 27 15:14:49.670418 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:14:49.670418 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:14:49.670418 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: 37f29ccc2165414e91f51a38d2d918dd May 27 15:14:49.670418 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-VolumesSnapshotsTestJSON-348655424-project May 27 15:14:49.670418 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: May 27 15:14:49.670418 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Snapshot eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09 could not be found. May 27 15:14:49.670418 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'id': 'eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09'} May 27 15:14:49.670418 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:14:49.671073 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:49.671073 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 27 15:14:49.671073 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 15:14:49.671073 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 27 15:14:49.671073 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 27 15:14:49.671073 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 27 15:14:49.671073 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 27 15:14:49.671073 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:14:49.671073 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:14:49.671073 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:14:49.671073 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:14:49.671073 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:14:49.671073 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:14:49.671073 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:14:49.671073 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:14:49.671073 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09 could not be found. (HTTP 404) (Request-ID: req-62547fab-2baa-422a-8363-8611425989a6) May 27 15:14:49.671073 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:14:49.671073 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:14:49.671905 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:14:49.671905 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:49.671905 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 27 15:14:49.671905 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 27 15:14:49.671905 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:14:49.671905 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:14:49.671905 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 27 15:14:49.671905 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 27 15:14:49.671905 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:14:49.671905 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:14:49.671905 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 27 15:14:49.671905 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 15:14:49.671905 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 27 15:14:49.671905 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 27 15:14:49.671905 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 27 15:14:49.671905 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 27 15:14:49.671905 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:14:49.671905 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:14:49.671905 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:14:49.672789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:14:49.672789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:14:49.672789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:14:49.672789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:14:49.672789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:14:49.672789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09 could not be found. May 27 15:14:49.672789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:14:49.672789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:14:49.672789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:14:49.672789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:49.672789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:14:49.672789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:14:49.672789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:14:49.672789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:14:49.672789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:14:49.672789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:14:49.672789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:14:49.672789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:14:49.672789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 27 15:14:49.672789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:14:49.673703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09 could not be found. May 27 15:14:49.673703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:14:49.673703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:14:49.673703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:14:49.673703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:49.673703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:14:49.673703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:14:49.673703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:14:49.673703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:14:49.673703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09 could not be found. May 27 15:14:49.673703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:14:49.673703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-934474e5-9667-4378-8940-d7a68de32366 tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Returning 404 to user: Snapshot eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09 could not be found. {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:14:49.673703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-934474e5-9667-4378-8940-d7a68de32366 tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09" status: 404 len: 111 microversion: 2.1 time: 0.065693 May 27 15:14:49.677746 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 10/29] 10.222.0.50 () {58 vars in 1250 bytes} [Fri May 27 15:14:49 2022] GET /compute/v2.1/os-snapshots/eb0c9c9d-3b4b-461a-ba5c-a4ce0889ec09 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:14:49.694726 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-56d68b73-5af4-4074-863d-090fc9b58c4a tempest-VolumesTestJSON-814338443 tempest-VolumesTestJSON-814338443-project] Calling method '.version_select at 0x7f57e261fca0>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:49.796206 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-92a861ec-e2d1-4736-b520-12d4f865a325 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:49.804709 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-92a861ec-e2d1-4736-b520-12d4f865a325 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1272 microversion: 2.1 time: 0.464699 May 27 15:14:49.805303 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 20/30] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:14:49 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1272 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:49.836927 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-d5a1ce8b-e10a-46f6-9f84-ba2168dbfde8 tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Calling method '.version_select at 0x7f57e35fb550>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:49.961185 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-56d68b73-5af4-4074-863d-090fc9b58c4a tempest-VolumesTestJSON-814338443 tempest-VolumesTestJSON-814338443-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.282260 May 27 15:14:49.971250 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 11/31] 10.222.0.50 () {58 vars in 1148 bytes} [Fri May 27 15:14:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:49.977608 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-6e2d42ff-f28d-4d12-9234-b01160cc84bb tempest-VolumesTestJSON-814338443 tempest-VolumesTestJSON-814338443-project] Calling method '.version_select at 0x7f57e261f700>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:49.991632 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-d5a1ce8b-e10a-46f6-9f84-ba2168dbfde8 tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/68f4086c-afce-4001-83fc-4af5abc4d196" status: 202 len: 0 microversion: 2.1 time: 0.169684 May 27 15:14:49.992383 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 21/32] 10.222.0.50 () {58 vars in 1247 bytes} [Fri May 27 15:14:49 2022] DELETE /compute/v2.1/os-volumes/68f4086c-afce-4001-83fc-4af5abc4d196 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:14:50.000841 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-fa0b3146-b0e2-4fa9-ae53-47842a22ea0e tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Calling method '.version_select at 0x7f57e36030d0>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:50.175756 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-fa0b3146-b0e2-4fa9-ae53-47842a22ea0e tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/68f4086c-afce-4001-83fc-4af5abc4d196" status: 200 len: 344 microversion: 2.1 time: 0.178905 May 27 15:14:50.176485 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 22/33] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 15:14:49 2022] GET /compute/v2.1/os-volumes/68f4086c-afce-4001-83fc-4af5abc4d196 => generated 344 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:14:50.269467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-6e2d42ff-f28d-4d12-9234-b01160cc84bb tempest-VolumesTestJSON-814338443 tempest-VolumesTestJSON-814338443-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.296109 May 27 15:14:50.272243 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 12/34] 10.222.0.50 () {58 vars in 1133 bytes} [Fri May 27 15:14:49 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:14:50.282219 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-79b02e60-904a-414f-bfb7-e898f5406176 tempest-VolumesTestJSON-814338443 tempest-VolumesTestJSON-814338443-project] Calling method '.version_select at 0x7f57e3603d30>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:50.523552 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-79b02e60-904a-414f-bfb7-e898f5406176 tempest-VolumesTestJSON-814338443 tempest-VolumesTestJSON-814338443-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.245053 May 27 15:14:50.524502 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 23/35] 10.222.0.50 () {58 vars in 1166 bytes} [Fri May 27 15:14:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:50.537010 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-5514c6df-dcb9-4767-88cc-41860c826bac tempest-VolumesTestJSON-814338443 tempest-VolumesTestJSON-814338443-project] Calling method '.version_select at 0x7f57e2603430>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:50.740172 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-5514c6df-dcb9-4767-88cc-41860c826bac tempest-VolumesTestJSON-814338443 tempest-VolumesTestJSON-814338443-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.206437 May 27 15:14:50.747871 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 13/36] 10.222.0.50 () {58 vars in 1169 bytes} [Fri May 27 15:14:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:50.753486 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-be2269b9-aec9-4f1a-ac9a-b3d55c442326 tempest-VolumesTestJSON-814338443 tempest-VolumesTestJSON-814338443-project] Calling method '.version_select at 0x7f57e3603c10>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:50.828750 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-49eabeba-8930-4f3f-b7b8-5c7d93286276 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:50.834201 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-49eabeba-8930-4f3f-b7b8-5c7d93286276 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:50.869179 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-49eabeba-8930-4f3f-b7b8-5c7d93286276 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:50.869968 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-49eabeba-8930-4f3f-b7b8-5c7d93286276 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:50.871685 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-49eabeba-8930-4f3f-b7b8-5c7d93286276 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:50.872430 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-49eabeba-8930-4f3f-b7b8-5c7d93286276 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:51.105696 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-be2269b9-aec9-4f1a-ac9a-b3d55c442326 tempest-VolumesTestJSON-814338443 tempest-VolumesTestJSON-814338443-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.356264 May 27 15:14:51.106696 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 24/37] 10.222.0.50 () {58 vars in 1154 bytes} [Fri May 27 15:14:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:51.119114 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-88dd642b-fdc5-4767-96d5-3363da5f1813 tempest-VolumesTestJSON-814338443 tempest-VolumesTestJSON-814338443-project] Calling method '.version_select at 0x7f57e35fb160>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:51.513909 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-88dd642b-fdc5-4767-96d5-3363da5f1813 tempest-VolumesTestJSON-814338443 tempest-VolumesTestJSON-814338443-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.399657 May 27 15:14:51.515907 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 25/38] 10.222.0.50 () {58 vars in 1187 bytes} [Fri May 27 15:14:51 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:14:51.521728 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-aabcd71e-b207-47ac-a0d9-e864b230418c tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Calling method '.version_select at 0x7f57e360fdc0>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:51.589292 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-aabcd71e-b207-47ac-a0d9-e864b230418c tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] HTTP exception thrown: Volume 68f4086c-afce-4001-83fc-4af5abc4d196 could not be found. May 27 15:14:51.593022 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-aabcd71e-b207-47ac-a0d9-e864b230418c tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Request method failure captured: May 27 15:14:51.593022 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/os-volumes/68f4086c-afce-4001-83fc-4af5abc4d196 HTTP/1.1 May 27 15:14:51.593022 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:14:51.593022 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:14:51.593022 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:14:51.593022 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:14:51.593022 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:14:51.593022 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:14:51.593022 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:14:51.593022 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:14:51.593022 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOrfXBCseXfcaz0YL164_ICLVtomjVE5J9WbDtTa0ahfa6DM0BPHEybgxFwPv7Scl4wJQ9LqUnFE9OSDnx4Wjc9z04QzDQlRKoomg59TKEXme0ssfKriySJaCkPTlF-S00vrIFSXoUa9ONVZ6j3gGuaZCOdlrDp1RNq2BxFpqjTOSl8 May 27 15:14:51.593022 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:14:51.593022 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:14:51.593022 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:14:51.593022 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:14:51.593022 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:14:51.593022 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:14:51.593022 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: d3a001740e9e476c9cee17b42c1c7816 May 27 15:14:51.593022 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-348655424 May 27 15:14:51.593022 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:14:51.593022 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:14:51.594193 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3a001740e9e476c9cee17b42c1c7816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d3a001740e9e476c9cee17b42c1c7816"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3a001740e9e476c9cee17b42c1c7816"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d3a001740e9e476c9cee17b42c1c7816"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:14:51.594193 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-VolumesSnapshotsTestJSON-348655424 May 27 15:14:51.594193 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: d3a001740e9e476c9cee17b42c1c7816 May 27 15:14:51.594193 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-348655424 May 27 15:14:51.594193 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-VolumesSnapshotsTestJSON-348655424-project May 27 15:14:51.594193 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:14:51.594193 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:14:51.594193 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 37f29ccc2165414e91f51a38d2d918dd May 27 15:14:51.594193 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-VolumesSnapshotsTestJSON-348655424-project May 27 15:14:51.594193 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: May 27 15:14:51.594193 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Volume 68f4086c-afce-4001-83fc-4af5abc4d196 could not be found. May 27 15:14:51.594193 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': '68f4086c-afce-4001-83fc-4af5abc4d196'} May 27 15:14:51.594193 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:14:51.594879 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:51.594879 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:14:51.594879 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:14:51.594879 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:14:51.594879 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:14:51.594879 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:14:51.594879 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:14:51.594879 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:14:51.594879 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:14:51.594879 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:14:51.594879 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:14:51.594879 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:14:51.594879 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:14:51.594879 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:14:51.594879 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:14:51.594879 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 68f4086c-afce-4001-83fc-4af5abc4d196 could not be found. (HTTP 404) (Request-ID: req-4bfc0568-8eb1-42ef-b928-2b28a0bea8f4) May 27 15:14:51.594879 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:51.594879 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:14:51.594879 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:51.597505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:51.597505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 15:14:51.597505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 15:14:51.597505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:14:51.597505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:14:51.597505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 15:14:51.597505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 15:14:51.597505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:14:51.597505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:14:51.597505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:14:51.597505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:14:51.597505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:14:51.597505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:14:51.597505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:14:51.597505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:14:51.597505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:14:51.597505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:14:51.597505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:14:51.597505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:14:51.598921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:14:51.598921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:14:51.598921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:14:51.598921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:14:51.598921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 68f4086c-afce-4001-83fc-4af5abc4d196 could not be found. May 27 15:14:51.598921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:51.598921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:14:51.598921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:51.598921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:51.598921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:14:51.598921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:14:51.598921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:14:51.598921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:14:51.598921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:14:51.598921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:14:51.598921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:14:51.598921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:14:51.598921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 15:14:51.598921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:14:51.601034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 68f4086c-afce-4001-83fc-4af5abc4d196 could not be found. May 27 15:14:51.601034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:51.601034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:14:51.601034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:51.601034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:51.601034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:14:51.601034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:14:51.601034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:14:51.601034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:14:51.601034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 68f4086c-afce-4001-83fc-4af5abc4d196 could not be found. May 27 15:14:51.601034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:51.605150 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-aabcd71e-b207-47ac-a0d9-e864b230418c tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Returning 404 to user: Volume 68f4086c-afce-4001-83fc-4af5abc4d196 could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:14:51.606902 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-aabcd71e-b207-47ac-a0d9-e864b230418c tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/68f4086c-afce-4001-83fc-4af5abc4d196" status: 404 len: 109 microversion: 2.1 time: 0.089692 May 27 15:14:51.608655 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 26/39] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 15:14:51 2022] GET /compute/v2.1/os-volumes/68f4086c-afce-4001-83fc-4af5abc4d196 => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:14:51.646019 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b502ce15-2741-4bdc-8bcd-4c884387c794 tempest-VolumesTestJSON-814338443 tempest-VolumesTestJSON-814338443-project] Calling method '.version_select at 0x7f57e35fb4c0>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:51.842666 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b502ce15-2741-4bdc-8bcd-4c884387c794 tempest-VolumesTestJSON-814338443 tempest-VolumesTestJSON-814338443-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.232717 May 27 15:14:51.853732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 27/40] 10.222.0.50 () {58 vars in 1154 bytes} [Fri May 27 15:14:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:51.853732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-19aeb056-3d89-427a-8d96-468a3b2f381c tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Calling method '.version_select at 0x7f57e3603940>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:51.919072 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-19aeb056-3d89-427a-8d96-468a3b2f381c tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] HTTP exception thrown: Volume 68f4086c-afce-4001-83fc-4af5abc4d196 could not be found. May 27 15:14:51.921815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-19aeb056-3d89-427a-8d96-468a3b2f381c tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Request method failure captured: May 27 15:14:51.921815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: DELETE /compute/v2.1/os-volumes/68f4086c-afce-4001-83fc-4af5abc4d196 HTTP/1.1 May 27 15:14:51.921815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:14:51.921815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:14:51.921815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:14:51.921815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:14:51.921815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:14:51.921815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:14:51.921815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:14:51.921815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:14:51.921815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOrfXBCseXfcaz0YL164_ICLVtomjVE5J9WbDtTa0ahfa6DM0BPHEybgxFwPv7Scl4wJQ9LqUnFE9OSDnx4Wjc9z04QzDQlRKoomg59TKEXme0ssfKriySJaCkPTlF-S00vrIFSXoUa9ONVZ6j3gGuaZCOdlrDp1RNq2BxFpqjTOSl8 May 27 15:14:51.921815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:14:51.921815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:14:51.921815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:14:51.921815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:14:51.921815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:14:51.921815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:14:51.921815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: d3a001740e9e476c9cee17b42c1c7816 May 27 15:14:51.921815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-348655424 May 27 15:14:51.921815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:14:51.921815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:14:51.923379 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3a001740e9e476c9cee17b42c1c7816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d3a001740e9e476c9cee17b42c1c7816"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3a001740e9e476c9cee17b42c1c7816"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d3a001740e9e476c9cee17b42c1c7816"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:14:51.923379 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-VolumesSnapshotsTestJSON-348655424 May 27 15:14:51.923379 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: d3a001740e9e476c9cee17b42c1c7816 May 27 15:14:51.923379 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-348655424 May 27 15:14:51.923379 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-VolumesSnapshotsTestJSON-348655424-project May 27 15:14:51.923379 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:14:51.923379 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:14:51.923379 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 37f29ccc2165414e91f51a38d2d918dd May 27 15:14:51.923379 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-VolumesSnapshotsTestJSON-348655424-project May 27 15:14:51.923379 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: May 27 15:14:51.923379 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Volume 68f4086c-afce-4001-83fc-4af5abc4d196 could not be found. May 27 15:14:51.923379 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': '68f4086c-afce-4001-83fc-4af5abc4d196'} May 27 15:14:51.923379 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:14:51.924041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:51.924041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:14:51.924041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:14:51.924041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 15:14:51.924041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 15:14:51.924041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 15:14:51.924041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 15:14:51.924041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 15:14:51.924041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 15:14:51.924041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 15:14:51.924041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 15:14:51.924041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:14:51.924041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:14:51.924041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:14:51.924041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:14:51.924041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 68f4086c-afce-4001-83fc-4af5abc4d196 could not be found. (HTTP 404) (Request-ID: req-905fb255-c620-4748-bd5e-59efcc6070f5) May 27 15:14:51.924041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:51.924041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:14:51.924041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:51.925509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:51.925509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 15:14:51.925509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 15:14:51.925509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:14:51.925509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:14:51.925509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 15:14:51.925509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 15:14:51.925509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:14:51.925509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:14:51.925509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:14:51.925509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:14:51.925509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 15:14:51.925509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 15:14:51.925509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 15:14:51.925509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 15:14:51.925509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 15:14:51.925509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 15:14:51.925509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 15:14:51.925509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 15:14:51.927066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:14:51.927066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:14:51.927066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:14:51.927066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:14:51.927066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 68f4086c-afce-4001-83fc-4af5abc4d196 could not be found. May 27 15:14:51.927066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:51.927066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:14:51.927066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:51.927066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:51.927066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:14:51.927066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:14:51.927066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:14:51.927066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:14:51.927066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:14:51.927066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:14:51.927066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:14:51.927066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:14:51.927066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 15:14:51.927066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:14:51.929468 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 68f4086c-afce-4001-83fc-4af5abc4d196 could not be found. May 27 15:14:51.929468 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:51.929468 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:14:51.929468 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:51.929468 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:51.929468 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:14:51.929468 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:14:51.929468 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:14:51.929468 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:14:51.929468 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 68f4086c-afce-4001-83fc-4af5abc4d196 could not be found. May 27 15:14:51.929468 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:51.945002 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-19aeb056-3d89-427a-8d96-468a3b2f381c tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Returning 404 to user: Volume 68f4086c-afce-4001-83fc-4af5abc4d196 could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:14:51.947596 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-19aeb056-3d89-427a-8d96-468a3b2f381c tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/68f4086c-afce-4001-83fc-4af5abc4d196" status: 404 len: 109 microversion: 2.1 time: 0.102016 May 27 15:14:51.948405 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 28/41] 10.222.0.50 () {58 vars in 1247 bytes} [Fri May 27 15:14:51 2022] DELETE /compute/v2.1/os-volumes/68f4086c-afce-4001-83fc-4af5abc4d196 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:14:51.958095 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-af88e972-437d-4283-b54f-7863dbec1f0a tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Calling method '.version_select at 0x7f57e35fb670>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:52.016024 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-af88e972-437d-4283-b54f-7863dbec1f0a tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] HTTP exception thrown: Volume 68f4086c-afce-4001-83fc-4af5abc4d196 could not be found. May 27 15:14:52.018420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-af88e972-437d-4283-b54f-7863dbec1f0a tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Request method failure captured: May 27 15:14:52.018420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/os-volumes/68f4086c-afce-4001-83fc-4af5abc4d196 HTTP/1.1 May 27 15:14:52.018420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:14:52.018420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:14:52.018420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:14:52.018420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:14:52.018420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:14:52.018420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:14:52.018420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:14:52.018420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:14:52.018420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOrfXBCseXfcaz0YL164_ICLVtomjVE5J9WbDtTa0ahfa6DM0BPHEybgxFwPv7Scl4wJQ9LqUnFE9OSDnx4Wjc9z04QzDQlRKoomg59TKEXme0ssfKriySJaCkPTlF-S00vrIFSXoUa9ONVZ6j3gGuaZCOdlrDp1RNq2BxFpqjTOSl8 May 27 15:14:52.018420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:14:52.018420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:14:52.018420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:14:52.018420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:14:52.018420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:14:52.018420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:14:52.018420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: d3a001740e9e476c9cee17b42c1c7816 May 27 15:14:52.018420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-348655424 May 27 15:14:52.018420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:14:52.018420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:14:52.019907 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3a001740e9e476c9cee17b42c1c7816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d3a001740e9e476c9cee17b42c1c7816"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d3a001740e9e476c9cee17b42c1c7816"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d3a001740e9e476c9cee17b42c1c7816"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:14:52.019907 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-VolumesSnapshotsTestJSON-348655424 May 27 15:14:52.019907 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: d3a001740e9e476c9cee17b42c1c7816 May 27 15:14:52.019907 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-348655424 May 27 15:14:52.019907 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-VolumesSnapshotsTestJSON-348655424-project May 27 15:14:52.019907 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:14:52.019907 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:14:52.019907 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 37f29ccc2165414e91f51a38d2d918dd May 27 15:14:52.019907 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-VolumesSnapshotsTestJSON-348655424-project May 27 15:14:52.019907 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: May 27 15:14:52.019907 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Volume 68f4086c-afce-4001-83fc-4af5abc4d196 could not be found. May 27 15:14:52.019907 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': '68f4086c-afce-4001-83fc-4af5abc4d196'} May 27 15:14:52.019907 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:14:52.021155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:52.021155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:14:52.021155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:14:52.021155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:14:52.021155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:14:52.021155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:14:52.021155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:14:52.021155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:14:52.021155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:14:52.021155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:14:52.021155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:14:52.021155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:14:52.021155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:14:52.021155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:14:52.021155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:14:52.021155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 68f4086c-afce-4001-83fc-4af5abc4d196 could not be found. (HTTP 404) (Request-ID: req-eba6b834-bf79-452c-b434-50ce788ca499) May 27 15:14:52.021155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:52.021155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:14:52.021155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:52.023003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:52.023003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 15:14:52.023003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 15:14:52.023003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:14:52.023003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:14:52.023003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 15:14:52.023003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 15:14:52.023003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:14:52.023003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:14:52.023003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:14:52.023003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:14:52.023003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:14:52.023003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:14:52.023003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:14:52.023003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:14:52.023003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:14:52.023003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:14:52.023003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:14:52.023003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:14:52.024176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:14:52.024176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:14:52.024176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:14:52.024176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:14:52.024176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 68f4086c-afce-4001-83fc-4af5abc4d196 could not be found. May 27 15:14:52.024176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:52.024176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:14:52.024176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:52.024176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:52.024176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:14:52.024176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:14:52.024176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:14:52.024176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:14:52.024176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:14:52.024176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:14:52.024176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:14:52.024176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:14:52.024176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 15:14:52.024176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:14:52.025059 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 68f4086c-afce-4001-83fc-4af5abc4d196 could not be found. May 27 15:14:52.025059 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:52.025059 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:14:52.025059 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:52.025059 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:14:52.025059 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:14:52.025059 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:14:52.025059 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:14:52.025059 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:14:52.025059 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 68f4086c-afce-4001-83fc-4af5abc4d196 could not be found. May 27 15:14:52.025059 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:14:52.027837 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-af88e972-437d-4283-b54f-7863dbec1f0a tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] Returning 404 to user: Volume 68f4086c-afce-4001-83fc-4af5abc4d196 could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:14:52.029136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-af88e972-437d-4283-b54f-7863dbec1f0a tempest-VolumesSnapshotsTestJSON-348655424 tempest-VolumesSnapshotsTestJSON-348655424-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/68f4086c-afce-4001-83fc-4af5abc4d196" status: 404 len: 109 microversion: 2.1 time: 0.075533 May 27 15:14:52.030421 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 29/42] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 15:14:51 2022] GET /compute/v2.1/os-volumes/68f4086c-afce-4001-83fc-4af5abc4d196 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:14:52.362556 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-49eabeba-8930-4f3f-b7b8-5c7d93286276 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:52.415573 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-49eabeba-8930-4f3f-b7b8-5c7d93286276 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1272 microversion: 2.1 time: 1.592692 May 27 15:14:52.419648 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 14/43] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:14:50 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1272 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:53.437781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-defb2097-5b9b-400b-8455-566df40655b1 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:53.438572 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-defb2097-5b9b-400b-8455-566df40655b1 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:53.456710 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-defb2097-5b9b-400b-8455-566df40655b1 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:53.457001 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-defb2097-5b9b-400b-8455-566df40655b1 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:53.457802 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-defb2097-5b9b-400b-8455-566df40655b1 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:53.458244 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-defb2097-5b9b-400b-8455-566df40655b1 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:53.914533 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-defb2097-5b9b-400b-8455-566df40655b1 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:53.925641 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-defb2097-5b9b-400b-8455-566df40655b1 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1314 microversion: 2.1 time: 0.492748 May 27 15:14:53.926840 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 30/44] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:14:53 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:54.944624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f48baf1b-c0cf-49d6-b042-0c02f4dc861d tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:54.945342 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-f48baf1b-c0cf-49d6-b042-0c02f4dc861d tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:54.962766 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f48baf1b-c0cf-49d6-b042-0c02f4dc861d tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:54.973830 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f48baf1b-c0cf-49d6-b042-0c02f4dc861d tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:54.976929 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f48baf1b-c0cf-49d6-b042-0c02f4dc861d tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:54.978904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f48baf1b-c0cf-49d6-b042-0c02f4dc861d tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:55.088234 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=2 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:55.089136 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=6 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:56.127116 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f48baf1b-c0cf-49d6-b042-0c02f4dc861d tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:56.155411 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-f48baf1b-c0cf-49d6-b042-0c02f4dc861d tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1314 microversion: 2.1 time: 1.213019 May 27 15:14:56.167735 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 15/45] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:14:54 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1314 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:57.065716 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=4 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:14:57.174839 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-02761d87-32cb-44b5-92bc-b8dedac280c5 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:57.176160 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-02761d87-32cb-44b5-92bc-b8dedac280c5 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:57.196528 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-02761d87-32cb-44b5-92bc-b8dedac280c5 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:57.200984 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-02761d87-32cb-44b5-92bc-b8dedac280c5 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:57.205386 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-02761d87-32cb-44b5-92bc-b8dedac280c5 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:57.208940 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-02761d87-32cb-44b5-92bc-b8dedac280c5 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:57.848763 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-02761d87-32cb-44b5-92bc-b8dedac280c5 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:14:57.862101 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-02761d87-32cb-44b5-92bc-b8dedac280c5 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1314 microversion: 2.1 time: 0.690967 May 27 15:14:57.865904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 16/46] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:14:57 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1314 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:14:57.992867 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8539236f-868d-45fc-8f29-19ba4d3d31f9 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Action: 'create', calling method: .version_select at 0x7f57e3603280>, body: {"keypair": {"name": "tempest-keypair-2085007690", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaVxCldUDQ62e2vTqunaSCj97DNSmXbaCgDMbZ19z7c0jUq41vB4ZytyymOZ3zJQ49FU5yd8dO+A4rthWkdNMA80TJ6Ena+7ihe/t4rFWKX9c5Pmu0WAVeXfCDpTm31og=="}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:58.347628 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-8539236f-868d-45fc-8f29-19ba4d3d31f9 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Getting quotas for project 0bf15a964f8048b48bc794051cd56add. Resources: {'key_pairs'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:14:58.401157 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-8539236f-868d-45fc-8f29-19ba4d3d31f9 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Getting quotas for user 387048f42b634693a7e827a8d88ef89b and project 0bf15a964f8048b48bc794051cd56add. Resources: {'key_pairs'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:14:58.617463 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-8539236f-868d-45fc-8f29-19ba4d3d31f9 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.556194 May 27 15:14:58.630080 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 31/47] 10.222.0.50 () {60 vars in 1158 bytes} [Fri May 27 15:14:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:14:59.001588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-9f5644ba-8ee2-4121-a3ee-2438b7099d36 req-a3aa67ea-7dbf-4b26-aaf7-47062a0c8a78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15b8928d-e849-4c12-b900-e0bfa48a1679", "tag": "ef128789-5dc1-48ac-aba6-775115b05e14"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:14:59.036639 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-9f5644ba-8ee2-4121-a3ee-2438b7099d36 req-a3aa67ea-7dbf-4b26-aaf7-47062a0c8a78 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:59.037264 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-9f5644ba-8ee2-4121-a3ee-2438b7099d36 req-a3aa67ea-7dbf-4b26-aaf7-47062a0c8a78 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:59.112255 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-9f5644ba-8ee2-4121-a3ee-2438b7099d36 req-a3aa67ea-7dbf-4b26-aaf7-47062a0c8a78 service nova] Creating event network-changed:ef128789-5dc1-48ac-aba6-775115b05e14 for instance 15b8928d-e849-4c12-b900-e0bfa48a1679 on hv-cinder-84254 May 27 15:14:59.112810 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-9f5644ba-8ee2-4121-a3ee-2438b7099d36 req-a3aa67ea-7dbf-4b26-aaf7-47062a0c8a78 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117743) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 15:14:59.114021 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-00af3ddd-1b8d-4e02-b02a-e13ef9ae64d9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:59.114471 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-00af3ddd-1b8d-4e02-b02a-e13ef9ae64d9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:59.115373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-00af3ddd-1b8d-4e02-b02a-e13ef9ae64d9 None None] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:59.115812 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-00af3ddd-1b8d-4e02-b02a-e13ef9ae64d9 None None] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:59.184362 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.compute.rpcapi [None req-00af3ddd-1b8d-4e02-b02a-e13ef9ae64d9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 27 15:14:59.185377 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-00af3ddd-1b8d-4e02-b02a-e13ef9ae64d9 None None] Releasing lock "compute-rpcapi-router" {{(pid=117743) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 15:14:59.249766 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-00af3ddd-1b8d-4e02-b02a-e13ef9ae64d9 None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.828387 May 27 15:14:59.250638 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 17/48] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:14:59.263556 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-e4aa62b9-1359-4b25-ae4d-cbd6f9ff82b4 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:14:59.264715 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-e4aa62b9-1359-4b25-ae4d-cbd6f9ff82b4 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:14:59.292006 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e4aa62b9-1359-4b25-ae4d-cbd6f9ff82b4 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:59.296889 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e4aa62b9-1359-4b25-ae4d-cbd6f9ff82b4 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:14:59.299940 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e4aa62b9-1359-4b25-ae4d-cbd6f9ff82b4 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:14:59.301697 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e4aa62b9-1359-4b25-ae4d-cbd6f9ff82b4 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:00.088092 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-9eca8599-c6b3-4219-be85-f645194636e6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Action: 'create', calling method: .version_select at 0x7f57e35d43a0>, body: {"keypair": {"name": "tempest-keypair-312635310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhd+yvSCfIH/t11kK9vKOseUDLtIwS0sfl8+Pch/B6LAf5YSAuPjbE10a6yPjcH8ukIvueq4g18VD9nR1rrxraC2FFD7YmZrXVYTkzw/h7KOeaKgUHAkjlCiH1pXpC0mQ=="}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:00.140676 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-9eca8599-c6b3-4219-be85-f645194636e6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Getting quotas for project f20b51981801495aacd31a56e87d0e3c. Resources: {'key_pairs'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:15:00.151652 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-9eca8599-c6b3-4219-be85-f645194636e6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Getting quotas for user 5a990918de6d409a949616da90de6a5e and project f20b51981801495aacd31a56e87d0e3c. Resources: {'key_pairs'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:15:00.221261 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-9eca8599-c6b3-4219-be85-f645194636e6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.415509 May 27 15:15:00.223687 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 32/49] 10.222.0.50 () {62 vars in 1199 bytes} [Fri May 27 15:14:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1421 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 27 15:15:00.462024 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-e4aa62b9-1359-4b25-ae4d-cbd6f9ff82b4 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:00.478794 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-e4aa62b9-1359-4b25-ae4d-cbd6f9ff82b4 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1314 microversion: 2.1 time: 1.226598 May 27 15:15:00.493098 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 18/50] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:14:59 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1314 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:01.501078 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-3e7e2209-5bf5-4461-b55a-79ae3c83203f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:01.501827 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-3e7e2209-5bf5-4461-b55a-79ae3c83203f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:01.513952 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3e7e2209-5bf5-4461-b55a-79ae3c83203f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:01.514720 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3e7e2209-5bf5-4461-b55a-79ae3c83203f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:01.522050 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3e7e2209-5bf5-4461-b55a-79ae3c83203f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:01.523626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3e7e2209-5bf5-4461-b55a-79ae3c83203f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:02.262604 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-3e7e2209-5bf5-4461-b55a-79ae3c83203f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:02.270495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-3e7e2209-5bf5-4461-b55a-79ae3c83203f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1314 microversion: 2.1 time: 0.773460 May 27 15:15:02.271112 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 33/51] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:01 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1314 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:03.290954 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d625a1ed-a31e-4aa0-ae62-f3e1276dc160 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:03.291687 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-d625a1ed-a31e-4aa0-ae62-f3e1276dc160 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:03.303079 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d625a1ed-a31e-4aa0-ae62-f3e1276dc160 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:03.304153 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d625a1ed-a31e-4aa0-ae62-f3e1276dc160 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:03.307184 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d625a1ed-a31e-4aa0-ae62-f3e1276dc160 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:03.307727 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d625a1ed-a31e-4aa0-ae62-f3e1276dc160 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:03.918821 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d625a1ed-a31e-4aa0-ae62-f3e1276dc160 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:03.931060 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-d625a1ed-a31e-4aa0-ae62-f3e1276dc160 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1314 microversion: 2.1 time: 0.646879 May 27 15:15:03.943802 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 19/52] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:03 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1314 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:04.306496 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-a527bd6f-233a-4cbb-9fce-ec52b2d9812b tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] Action: 'create', calling method: .version_select at 0x7f57e2d80ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1874492626", "metadata": {"Type": "work"}}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:04.322391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-a527bd6f-233a-4cbb-9fce-ec52b2d9812b tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] Request method failure captured: May 27 15:15:04.322391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 15:15:04.322391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:15:04.322391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:15:04.322391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:15:04.322391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 122 May 27 15:15:04.322391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:15:04.322391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:15:04.322391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:15:04.322391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:15:04.322391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOr3aY9VPRo4FPmuBOLPAYwz464JqRcEv9irKGmjapidSEXkRls3HPfimTobKy9oQTTw56MVMBhljhfsRs8LT5u48GXbqnuexOdcHnv-2rUBq4sWX1swmEoZdMuUog7rLvBd0rUj_qm7aPrVIkmtb_DUHOzFr19104EFKKMhEOl3n0Q May 27 15:15:04.322391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:15:04.322391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:15:04.322391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:15:04.322391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:15:04.322391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:15:04.322391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:15:04.322391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: 8293dd408a05464f987aa79eed0d09fa May 27 15:15:04.322391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-VolumesNegativeTest-109736223 May 27 15:15:04.322391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:15:04.322391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:15:04.325301 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:15:04.325301 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-VolumesNegativeTest-109736223 May 27 15:15:04.325301 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: 8293dd408a05464f987aa79eed0d09fa May 27 15:15:04.325301 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-VolumesNegativeTest-109736223 May 27 15:15:04.325301 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-VolumesNegativeTest-109736223-project May 27 15:15:04.325301 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:15:04.325301 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:15:04.325301 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 61dd84b3080d445abb173ab3642f6886 May 27 15:15:04.325301 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-VolumesNegativeTest-109736223-project May 27 15:15:04.325301 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: May 27 15:15:04.325301 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1874492626", "metadata": {"Type": "work"}}} May 27 15:15:04.325301 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: May 27 15:15:04.325301 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 15:15:04.326177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1874492626', 'metadata': {'Type': 'work'}}}} May 27 15:15:04.326177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:15:04.326177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:04.326177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:15:04.326177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:15:04.326177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:15:04.326177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise error May 27 15:15:04.326177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 27 15:15:04.326177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.326177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 27 15:15:04.326177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 15:15:04.326177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.326177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 15:15:04.326177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi '#$%' May 27 15:15:04.326177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.326177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:04.326177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.326177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:04.326177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:04.326177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:04.326177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:15:04.326177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:15:04.327480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:15:04.327480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:15:04.327480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:15:04.327480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:15:04.327480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:15:04.327480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:15:04.327480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:15:04.327480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:15:04.327480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:15:04.327480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:15:04.327480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 15:15:04.327480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.327480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:04.327480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.327480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:04.327480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:04.327480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:04.327480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:15:04.327480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:15:04.328540 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 15:15:04.328540 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.328540 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-a527bd6f-233a-4cbb-9fce-ec52b2d9812b tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:15:04.328540 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-a527bd6f-233a-4cbb-9fce-ec52b2d9812b tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.553242 May 27 15:15:04.329033 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 34/53] 10.222.0.50 () {60 vars in 1155 bytes} [Fri May 27 15:15:03 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 557 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:15:04.340964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-fed1fd84-5d15-4e72-9992-ea9bc4c2ea13 tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] Action: 'create', calling method: .version_select at 0x7f57e252eaf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-124449232", "metadata": {"Type": "work"}}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:04.348215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-fed1fd84-5d15-4e72-9992-ea9bc4c2ea13 tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] Request method failure captured: May 27 15:15:04.348215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 15:15:04.348215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:15:04.348215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:15:04.348215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:15:04.348215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 119 May 27 15:15:04.348215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:15:04.348215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:15:04.348215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:15:04.348215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:15:04.348215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOr3aY9VPRo4FPmuBOLPAYwz464JqRcEv9irKGmjapidSEXkRls3HPfimTobKy9oQTTw56MVMBhljhfsRs8LT5u48GXbqnuexOdcHnv-2rUBq4sWX1swmEoZdMuUog7rLvBd0rUj_qm7aPrVIkmtb_DUHOzFr19104EFKKMhEOl3n0Q May 27 15:15:04.348215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:15:04.348215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:15:04.348215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:15:04.348215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:15:04.348215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:15:04.348215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:15:04.348215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: 8293dd408a05464f987aa79eed0d09fa May 27 15:15:04.348215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-VolumesNegativeTest-109736223 May 27 15:15:04.348215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:15:04.348215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:15:04.349596 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:15:04.349596 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-VolumesNegativeTest-109736223 May 27 15:15:04.349596 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: 8293dd408a05464f987aa79eed0d09fa May 27 15:15:04.349596 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-VolumesNegativeTest-109736223 May 27 15:15:04.349596 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-VolumesNegativeTest-109736223-project May 27 15:15:04.349596 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:15:04.349596 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:15:04.349596 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: 61dd84b3080d445abb173ab3642f6886 May 27 15:15:04.349596 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-VolumesNegativeTest-109736223-project May 27 15:15:04.349596 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: May 27 15:15:04.349596 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-124449232", "metadata": {"Type": "work"}}} May 27 15:15:04.349596 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: May 27 15:15:04.349596 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 15:15:04.350343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-124449232', 'metadata': {'Type': 'work'}}}} May 27 15:15:04.350343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:15:04.350343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:04.350343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:15:04.350343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:15:04.350343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:15:04.350343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise error May 27 15:15:04.350343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 27 15:15:04.350343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:04.350343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 27 15:15:04.350343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 15:15:04.350343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:04.350343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 15:15:04.350343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi '0' May 27 15:15:04.350343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:04.350343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:04.350343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:04.350343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:04.350343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:04.350343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:04.350343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:15:04.350343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:15:04.351746 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:15:04.351746 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:15:04.351746 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:15:04.351746 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:15:04.351746 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:15:04.351746 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:15:04.351746 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:15:04.351746 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:15:04.351746 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:15:04.351746 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:15:04.351746 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 15:15:04.351746 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:04.351746 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:04.351746 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:04.351746 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:04.351746 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:04.351746 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:04.351746 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:15:04.351746 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:15:04.352804 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 15:15:04.352804 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:04.352804 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-fed1fd84-5d15-4e72-9992-ea9bc4c2ea13 tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:15:04.353697 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-fed1fd84-5d15-4e72-9992-ea9bc4c2ea13 tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.019207 May 27 15:15:04.354834 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 20/54] 10.222.0.50 () {60 vars in 1155 bytes} [Fri May 27 15:15:04 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:15:04.365508 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-1e5d4aa8-1589-41ca-bfa0-446914d99cd2 tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] Action: 'create', calling method: .version_select at 0x7f57e2d9b790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-321516462", "metadata": {"Type": "work"}}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:04.368262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-1e5d4aa8-1589-41ca-bfa0-446914d99cd2 tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] Request method failure captured: May 27 15:15:04.368262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 15:15:04.368262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:15:04.368262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:15:04.368262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:15:04.368262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 118 May 27 15:15:04.368262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:15:04.368262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:15:04.368262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:15:04.368262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:15:04.368262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOr3aY9VPRo4FPmuBOLPAYwz464JqRcEv9irKGmjapidSEXkRls3HPfimTobKy9oQTTw56MVMBhljhfsRs8LT5u48GXbqnuexOdcHnv-2rUBq4sWX1swmEoZdMuUog7rLvBd0rUj_qm7aPrVIkmtb_DUHOzFr19104EFKKMhEOl3n0Q May 27 15:15:04.368262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:15:04.368262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:15:04.368262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:15:04.368262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:15:04.368262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:15:04.368262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:15:04.368262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: 8293dd408a05464f987aa79eed0d09fa May 27 15:15:04.368262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-VolumesNegativeTest-109736223 May 27 15:15:04.368262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:15:04.368262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:15:04.369408 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:15:04.369408 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-VolumesNegativeTest-109736223 May 27 15:15:04.369408 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: 8293dd408a05464f987aa79eed0d09fa May 27 15:15:04.369408 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-VolumesNegativeTest-109736223 May 27 15:15:04.369408 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-VolumesNegativeTest-109736223-project May 27 15:15:04.369408 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:15:04.369408 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:15:04.369408 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 61dd84b3080d445abb173ab3642f6886 May 27 15:15:04.369408 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-VolumesNegativeTest-109736223-project May 27 15:15:04.369408 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: May 27 15:15:04.369408 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-321516462", "metadata": {"Type": "work"}}} May 27 15:15:04.369408 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: May 27 15:15:04.369408 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 15:15:04.370183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-321516462', 'metadata': {'Type': 'work'}}}} May 27 15:15:04.370183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:15:04.370183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:04.370183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 15:15:04.370183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 15:15:04.370183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 15:15:04.370183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise error May 27 15:15:04.370183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 27 15:15:04.370183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.370183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 27 15:15:04.370183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 15:15:04.370183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.370183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 15:15:04.370183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi '' May 27 15:15:04.370183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.370183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:04.370183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.370183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:04.370183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:04.370183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:04.370183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:15:04.370183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:15:04.371570 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:15:04.371570 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:15:04.371570 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:15:04.371570 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:15:04.371570 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 15:15:04.371570 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 15:15:04.371570 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 15:15:04.371570 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 15:15:04.371570 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 15:15:04.371570 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 15:15:04.371570 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 15:15:04.371570 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.371570 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:04.371570 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.371570 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:04.371570 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:04.371570 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:04.371570 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 15:15:04.371570 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 15:15:04.372618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 15:15:04.372618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.372618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-1e5d4aa8-1589-41ca-bfa0-446914d99cd2 tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:15:04.372618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-1e5d4aa8-1589-41ca-bfa0-446914d99cd2 tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009141 May 27 15:15:04.380152 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-902a9e4a-7a4c-46b1-a134-dcfddd456581 tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] Calling method '.version_select at 0x7f57e2551310>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:04.383655 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 35/55] 10.222.0.50 () {60 vars in 1155 bytes} [Fri May 27 15:15:04 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:15:04.468496 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-902a9e4a-7a4c-46b1-a134-dcfddd456581 tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] HTTP exception thrown: Volume tempest-invalid-97807763 could not be found. May 27 15:15:04.472369 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-902a9e4a-7a4c-46b1-a134-dcfddd456581 tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] Request method failure captured: May 27 15:15:04.472369 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-97807763 HTTP/1.1 May 27 15:15:04.472369 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:15:04.472369 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:15:04.472369 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:15:04.472369 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 0 May 27 15:15:04.472369 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:15:04.472369 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:15:04.472369 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:15:04.472369 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:15:04.472369 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOr3aY9VPRo4FPmuBOLPAYwz464JqRcEv9irKGmjapidSEXkRls3HPfimTobKy9oQTTw56MVMBhljhfsRs8LT5u48GXbqnuexOdcHnv-2rUBq4sWX1swmEoZdMuUog7rLvBd0rUj_qm7aPrVIkmtb_DUHOzFr19104EFKKMhEOl3n0Q May 27 15:15:04.472369 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:15:04.472369 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:15:04.472369 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:15:04.472369 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:15:04.472369 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:15:04.472369 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:15:04.472369 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: 8293dd408a05464f987aa79eed0d09fa May 27 15:15:04.472369 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-VolumesNegativeTest-109736223 May 27 15:15:04.472369 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:15:04.472369 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:15:04.473610 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:15:04.473610 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-VolumesNegativeTest-109736223 May 27 15:15:04.473610 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: 8293dd408a05464f987aa79eed0d09fa May 27 15:15:04.473610 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-VolumesNegativeTest-109736223 May 27 15:15:04.473610 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-VolumesNegativeTest-109736223-project May 27 15:15:04.473610 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:15:04.473610 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:15:04.473610 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: 61dd84b3080d445abb173ab3642f6886 May 27 15:15:04.473610 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-VolumesNegativeTest-109736223-project May 27 15:15:04.473610 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: May 27 15:15:04.473610 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Volume tempest-invalid-97807763 could not be found. May 27 15:15:04.473610 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'id': 'tempest-invalid-97807763'} May 27 15:15:04.473610 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:15:04.473610 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:04.474373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:15:04.474373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:15:04.474373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 15:15:04.474373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 15:15:04.474373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 15:15:04.474373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 15:15:04.474373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 15:15:04.474373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 15:15:04.474373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 15:15:04.474373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 15:15:04.474373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:15:04.474373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:15:04.474373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:15:04.474373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:15:04.474373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-97807763 could not be found. (HTTP 404) (Request-ID: req-08da4f87-125f-4545-9ebf-32027bbaa773) May 27 15:15:04.474373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:04.474373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:04.474373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:04.474373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:04.475447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 15:15:04.475447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 15:15:04.475447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:15:04.475447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:15:04.475447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 15:15:04.475447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 15:15:04.475447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:15:04.475447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:15:04.475447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:15:04.475447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:15:04.475447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 15:15:04.475447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 15:15:04.475447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 15:15:04.475447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 15:15:04.475447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 15:15:04.475447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 15:15:04.475447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 15:15:04.475447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 15:15:04.476675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:15:04.476675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:15:04.476675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:15:04.476675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:15:04.476675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-97807763 could not be found. May 27 15:15:04.476675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:04.476675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:04.476675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:04.476675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:04.476675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:04.476675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:04.476675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:15:04.476675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:15:04.476675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:15:04.476675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:15:04.476675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:15:04.476675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:15:04.476675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 15:15:04.476675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:15:04.476675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-97807763 could not be found. May 27 15:15:04.478072 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:04.478072 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:04.478072 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:04.478072 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:04.478072 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:04.478072 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:04.478072 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:15:04.478072 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:15:04.478072 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-97807763 could not be found. May 27 15:15:04.478072 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:04.481322 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-902a9e4a-7a4c-46b1-a134-dcfddd456581 tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] Returning 404 to user: Volume tempest-invalid-97807763 could not be found. {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:15:04.482449 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-902a9e4a-7a4c-46b1-a134-dcfddd456581 tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/tempest-invalid-97807763" status: 404 len: 97 microversion: 2.1 time: 0.106561 May 27 15:15:04.483568 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 21/56] 10.222.0.50 () {58 vars in 1211 bytes} [Fri May 27 15:15:04 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-97807763 => generated 97 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 27 15:15:04.494038 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-9058a2f2-e412-42ad-8a66-fb48bf00939f tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004804 May 27 15:15:04.495164 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 36/57] 10.222.0.50 () {58 vars in 1139 bytes} [Fri May 27 15:15:04 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 27 15:15:04.507801 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-65030dde-4a8f-49e1-a355-36f8ca37dc1b tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006288 May 27 15:15:04.510186 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 22/58] 10.222.0.50 () {58 vars in 1136 bytes} [Fri May 27 15:15:04 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 27 15:15:04.518538 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b32f4fc9-34cf-42b9-bab8-6bb9d7061fc2 tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] Calling method '.version_select at 0x7f57e2d9bc10>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:04.540173 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-e80fcfd5-c0e4-4ad6-8761-ecbc3730e696 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1372190729", "imageRef": "a9407644-1f68-43e6-beb1-ce2085766180", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de4024f8-b7b6-4399-919f-5f2498131cc8"}], "security_groups": [{"name": "tempest-securitygroup--1181603749"}], "key_name": "tempest-keypair-2085007690", "user_data": "}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:04.585315 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-b32f4fc9-34cf-42b9-bab8-6bb9d7061fc2 tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] HTTP exception thrown: Volume 35cb4c07-5480-4daa-8145-f8f6a51ec156 could not be found. May 27 15:15:04.587891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b32f4fc9-34cf-42b9-bab8-6bb9d7061fc2 tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] Request method failure captured: May 27 15:15:04.587891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: DELETE /compute/v2.1/os-volumes/35cb4c07-5480-4daa-8145-f8f6a51ec156 HTTP/1.1 May 27 15:15:04.587891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:15:04.587891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:15:04.587891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:15:04.587891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:15:04.587891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:15:04.587891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:15:04.587891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:15:04.587891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:15:04.587891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOr3aY9VPRo4FPmuBOLPAYwz464JqRcEv9irKGmjapidSEXkRls3HPfimTobKy9oQTTw56MVMBhljhfsRs8LT5u48GXbqnuexOdcHnv-2rUBq4sWX1swmEoZdMuUog7rLvBd0rUj_qm7aPrVIkmtb_DUHOzFr19104EFKKMhEOl3n0Q May 27 15:15:04.587891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:15:04.587891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:15:04.587891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:15:04.587891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:15:04.587891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:15:04.587891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:15:04.587891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: 8293dd408a05464f987aa79eed0d09fa May 27 15:15:04.587891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-VolumesNegativeTest-109736223 May 27 15:15:04.587891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:15:04.587891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:15:04.589353 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:15:04.589353 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-VolumesNegativeTest-109736223 May 27 15:15:04.589353 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: 8293dd408a05464f987aa79eed0d09fa May 27 15:15:04.589353 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-VolumesNegativeTest-109736223 May 27 15:15:04.589353 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-VolumesNegativeTest-109736223-project May 27 15:15:04.589353 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:15:04.589353 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:15:04.589353 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 61dd84b3080d445abb173ab3642f6886 May 27 15:15:04.589353 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-VolumesNegativeTest-109736223-project May 27 15:15:04.589353 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: May 27 15:15:04.589353 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Volume 35cb4c07-5480-4daa-8145-f8f6a51ec156 could not be found. May 27 15:15:04.589353 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': '35cb4c07-5480-4daa-8145-f8f6a51ec156'} May 27 15:15:04.589353 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:15:04.595106 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:04.595106 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:15:04.595106 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:15:04.595106 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 15:15:04.595106 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 15:15:04.595106 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 15:15:04.595106 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 15:15:04.595106 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 15:15:04.595106 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 15:15:04.595106 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 15:15:04.595106 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 15:15:04.595106 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:15:04.595106 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:15:04.595106 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:15:04.595106 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:15:04.595106 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 35cb4c07-5480-4daa-8145-f8f6a51ec156 could not be found. (HTTP 404) (Request-ID: req-5141ce03-748d-4cac-9e51-a61b1e3cadf4) May 27 15:15:04.595106 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.595106 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:04.595106 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.596365 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:04.596365 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 15:15:04.596365 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 15:15:04.596365 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:15:04.596365 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:15:04.596365 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 15:15:04.596365 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 15:15:04.596365 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:15:04.596365 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:15:04.596365 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:15:04.596365 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:15:04.596365 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 15:15:04.596365 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 15:15:04.596365 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 15:15:04.596365 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 15:15:04.596365 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 15:15:04.596365 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 15:15:04.596365 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 15:15:04.596365 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 15:15:04.597427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:15:04.597427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:15:04.597427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:15:04.597427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:15:04.597427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 35cb4c07-5480-4daa-8145-f8f6a51ec156 could not be found. May 27 15:15:04.597427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.597427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:04.597427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.597427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:04.597427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:04.597427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:04.597427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:15:04.597427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:15:04.597427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:15:04.597427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:15:04.597427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:15:04.597427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:15:04.597427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 15:15:04.597427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:15:04.598456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 35cb4c07-5480-4daa-8145-f8f6a51ec156 could not be found. May 27 15:15:04.598456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.598456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:04.598456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.598456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:04.598456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:04.598456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:04.598456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:15:04.598456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:15:04.598456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 35cb4c07-5480-4daa-8145-f8f6a51ec156 could not be found. May 27 15:15:04.598456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.598456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b32f4fc9-34cf-42b9-bab8-6bb9d7061fc2 tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] Returning 404 to user: Volume 35cb4c07-5480-4daa-8145-f8f6a51ec156 could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:15:04.598456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b32f4fc9-34cf-42b9-bab8-6bb9d7061fc2 tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/35cb4c07-5480-4daa-8145-f8f6a51ec156" status: 404 len: 109 microversion: 2.1 time: 0.075236 May 27 15:15:04.598456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 37/59] 10.222.0.50 () {58 vars in 1247 bytes} [Fri May 27 15:15:04 2022] DELETE /compute/v2.1/os-volumes/35cb4c07-5480-4daa-8145-f8f6a51ec156 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:15:04.600501 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8010a86a-7bb2-4dc1-b498-b100f467cb9c tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] Calling method '.version_select at 0x7f57e2d80940>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:04.670108 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-8010a86a-7bb2-4dc1-b498-b100f467cb9c tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] HTTP exception thrown: Volume f001cbc8-b3f2-4048-b6c4-58847f93ffcc could not be found. May 27 15:15:04.677090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8010a86a-7bb2-4dc1-b498-b100f467cb9c tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] Request method failure captured: May 27 15:15:04.677090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/os-volumes/f001cbc8-b3f2-4048-b6c4-58847f93ffcc HTTP/1.1 May 27 15:15:04.677090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:15:04.677090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:15:04.677090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:15:04.677090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:15:04.677090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:15:04.677090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:15:04.677090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:15:04.677090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:15:04.677090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOr3aY9VPRo4FPmuBOLPAYwz464JqRcEv9irKGmjapidSEXkRls3HPfimTobKy9oQTTw56MVMBhljhfsRs8LT5u48GXbqnuexOdcHnv-2rUBq4sWX1swmEoZdMuUog7rLvBd0rUj_qm7aPrVIkmtb_DUHOzFr19104EFKKMhEOl3n0Q May 27 15:15:04.677090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:15:04.677090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:15:04.677090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:15:04.677090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:15:04.677090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:15:04.677090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:15:04.677090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: 8293dd408a05464f987aa79eed0d09fa May 27 15:15:04.677090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-VolumesNegativeTest-109736223 May 27 15:15:04.677090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:15:04.677090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:15:04.678523 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8293dd408a05464f987aa79eed0d09fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:15:04.678523 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-VolumesNegativeTest-109736223 May 27 15:15:04.678523 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: 8293dd408a05464f987aa79eed0d09fa May 27 15:15:04.678523 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-VolumesNegativeTest-109736223 May 27 15:15:04.678523 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-VolumesNegativeTest-109736223-project May 27 15:15:04.678523 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:15:04.678523 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:15:04.678523 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 61dd84b3080d445abb173ab3642f6886 May 27 15:15:04.678523 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-VolumesNegativeTest-109736223-project May 27 15:15:04.678523 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: May 27 15:15:04.678523 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Volume f001cbc8-b3f2-4048-b6c4-58847f93ffcc could not be found. May 27 15:15:04.678523 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': 'f001cbc8-b3f2-4048-b6c4-58847f93ffcc'} May 27 15:15:04.678523 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:15:04.679704 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:04.679704 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:15:04.679704 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:15:04.679704 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:15:04.679704 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:15:04.679704 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:15:04.679704 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:15:04.679704 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:15:04.679704 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:15:04.679704 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:15:04.679704 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:15:04.679704 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:15:04.679704 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:15:04.679704 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:15:04.679704 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:15:04.679704 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f001cbc8-b3f2-4048-b6c4-58847f93ffcc could not be found. (HTTP 404) (Request-ID: req-7ddf0c93-d1b2-4a48-883e-6dcbbfbcc148) May 27 15:15:04.679704 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.679704 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:04.679704 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.689771 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:04.689771 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 15:15:04.689771 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 15:15:04.689771 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 15:15:04.689771 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 15:15:04.689771 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 15:15:04.689771 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 15:15:04.689771 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 15:15:04.689771 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 15:15:04.689771 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 15:15:04.689771 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 15:15:04.689771 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 15:15:04.689771 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 15:15:04.689771 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 15:15:04.689771 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 15:15:04.689771 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 15:15:04.689771 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 15:15:04.689771 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 15:15:04.689771 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 15:15:04.691044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 15:15:04.691044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 15:15:04.691044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 15:15:04.691044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 15:15:04.691044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f001cbc8-b3f2-4048-b6c4-58847f93ffcc could not be found. May 27 15:15:04.691044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.691044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:04.691044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.691044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:04.691044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:04.691044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:04.691044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:15:04.691044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:15:04.691044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 15:15:04.691044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 15:15:04.691044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:15:04.691044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:15:04.691044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 15:15:04.691044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:15:04.693400 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f001cbc8-b3f2-4048-b6c4-58847f93ffcc could not be found. May 27 15:15:04.693400 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.693400 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:04.693400 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.693400 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:04.693400 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:04.693400 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:04.693400 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:15:04.693400 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:15:04.693400 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f001cbc8-b3f2-4048-b6c4-58847f93ffcc could not be found. May 27 15:15:04.693400 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:04.693400 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8010a86a-7bb2-4dc1-b498-b100f467cb9c tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] Returning 404 to user: Volume f001cbc8-b3f2-4048-b6c4-58847f93ffcc could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:15:04.693400 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-8010a86a-7bb2-4dc1-b498-b100f467cb9c tempest-VolumesNegativeTest-109736223 tempest-VolumesNegativeTest-109736223-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/f001cbc8-b3f2-4048-b6c4-58847f93ffcc" status: 404 len: 109 microversion: 2.1 time: 0.082639 May 27 15:15:04.693400 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 38/60] 10.222.0.50 () {58 vars in 1244 bytes} [Fri May 27 15:15:04 2022] GET /compute/v2.1/os-volumes/f001cbc8-b3f2-4048-b6c4-58847f93ffcc => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:15:04.951455 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b09ec8f4-11b7-4b6c-9e85-b5872deaf879 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:04.952073 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b09ec8f4-11b7-4b6c-9e85-b5872deaf879 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:04.964303 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b09ec8f4-11b7-4b6c-9e85-b5872deaf879 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:04.970137 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b09ec8f4-11b7-4b6c-9e85-b5872deaf879 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:04.971007 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b09ec8f4-11b7-4b6c-9e85-b5872deaf879 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:04.973170 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b09ec8f4-11b7-4b6c-9e85-b5872deaf879 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:05.259959 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.network.neutron [None req-e80fcfd5-c0e4-4ad6-8761-ecbc3730e696 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] validate_networks() for [('de4024f8-b7b6-4399-919f-5f2498131cc8', None, None, None, None, None)] {{(pid=117743) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:15:05.767585 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b09ec8f4-11b7-4b6c-9e85-b5872deaf879 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:05.777837 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b09ec8f4-11b7-4b6c-9e85-b5872deaf879 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1314 microversion: 2.1 time: 0.831567 May 27 15:15:05.778415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 39/61] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:04 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1314 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:06.797158 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-9121b5d1-ef34-4658-a87f-02fb61dd2276 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:06.798457 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-9121b5d1-ef34-4658-a87f-02fb61dd2276 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:06.808095 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9121b5d1-ef34-4658-a87f-02fb61dd2276 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:06.809935 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9121b5d1-ef34-4658-a87f-02fb61dd2276 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:06.810805 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9121b5d1-ef34-4658-a87f-02fb61dd2276 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:06.811345 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9121b5d1-ef34-4658-a87f-02fb61dd2276 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:06.820115 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-e80fcfd5-c0e4-4ad6-8761-ecbc3730e696 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Flavor limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:15:06.820673 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-e80fcfd5-c0e4-4ad6-8761-ecbc3730e696 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Image limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:15:06.822681 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-e80fcfd5-c0e4-4ad6-8761-ecbc3730e696 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Flavor pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:15:06.823233 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-e80fcfd5-c0e4-4ad6-8761-ecbc3730e696 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Image pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:15:06.824109 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-e80fcfd5-c0e4-4ad6-8761-ecbc3730e696 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:15:06.848981 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e80fcfd5-c0e4-4ad6-8761-ecbc3730e696 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:06.849446 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e80fcfd5-c0e4-4ad6-8761-ecbc3730e696 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:06.850637 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e80fcfd5-c0e4-4ad6-8761-ecbc3730e696 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:06.851941 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e80fcfd5-c0e4-4ad6-8761-ecbc3730e696 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:06.910353 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-e80fcfd5-c0e4-4ad6-8761-ecbc3730e696 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Getting quotas for project 0bf15a964f8048b48bc794051cd56add. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:15:06.919674 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-e80fcfd5-c0e4-4ad6-8761-ecbc3730e696 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Getting quotas for user 387048f42b634693a7e827a8d88ef89b and project 0bf15a964f8048b48bc794051cd56add. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:15:06.950398 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-e80fcfd5-c0e4-4ad6-8761-ecbc3730e696 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Going to run 1 instances... {{(pid=117743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:15:06.957067 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-e80fcfd5-c0e4-4ad6-8761-ecbc3730e696 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9407644-1f68-43e6-beb1-ce2085766180',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:15:07.063913 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-e80fcfd5-c0e4-4ad6-8761-ecbc3730e696 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.527292 May 27 15:15:07.064733 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 23/62] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 15:15:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 2530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:15:07.078999 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d6e83c97-445f-4b0d-a406-bb6e6d826710 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1887435806", "imageRef": "a9407644-1f68-43e6-beb1-ce2085766180", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "275a0f8b-f6c2-4374-b604-c47608ee55ce"}], "security_groups": [{"name": "tempest-securitygroup--748957398"}], "key_name": "tempest-keypair-312635310", "user_data": "}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:07.105758 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-9121b5d1-ef34-4658-a87f-02fb61dd2276 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:07.140325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-9121b5d1-ef34-4658-a87f-02fb61dd2276 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1314 microversion: 2.1 time: 0.348943 May 27 15:15:07.146778 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 40/63] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:06 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:07.171092 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-c992b450-1467-4b8e-addd-9e015689a514 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:07.173378 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-c992b450-1467-4b8e-addd-9e015689a514 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:07.258060 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-c992b450-1467-4b8e-addd-9e015689a514 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:07.266480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-c992b450-1467-4b8e-addd-9e015689a514 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1238 microversion: 2.1 time: 0.106295 May 27 15:15:07.270663 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 41/64] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:07 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1238 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:07.316839 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.network.neutron [None req-d6e83c97-445f-4b0d-a406-bb6e6d826710 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] validate_networks() for [('275a0f8b-f6c2-4374-b604-c47608ee55ce', None, None, None, None, None)] {{(pid=117743) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:15:07.906100 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-d6e83c97-445f-4b0d-a406-bb6e6d826710 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Flavor limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:15:07.907885 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-d6e83c97-445f-4b0d-a406-bb6e6d826710 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Image limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:15:07.908575 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-d6e83c97-445f-4b0d-a406-bb6e6d826710 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Flavor pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:15:07.909481 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-d6e83c97-445f-4b0d-a406-bb6e6d826710 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Image pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:15:07.910098 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-d6e83c97-445f-4b0d-a406-bb6e6d826710 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:15:07.921950 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d6e83c97-445f-4b0d-a406-bb6e6d826710 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:07.922830 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d6e83c97-445f-4b0d-a406-bb6e6d826710 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:07.924394 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d6e83c97-445f-4b0d-a406-bb6e6d826710 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:07.925215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d6e83c97-445f-4b0d-a406-bb6e6d826710 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:07.955748 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-d6e83c97-445f-4b0d-a406-bb6e6d826710 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Getting quotas for project f20b51981801495aacd31a56e87d0e3c. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:15:07.961672 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-d6e83c97-445f-4b0d-a406-bb6e6d826710 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Getting quotas for user 5a990918de6d409a949616da90de6a5e and project f20b51981801495aacd31a56e87d0e3c. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:15:07.987355 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-d6e83c97-445f-4b0d-a406-bb6e6d826710 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Going to run 1 instances... {{(pid=117743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:15:07.989602 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-d6e83c97-445f-4b0d-a406-bb6e6d826710 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9407644-1f68-43e6-beb1-ce2085766180',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:15:08.048537 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-d6e83c97-445f-4b0d-a406-bb6e6d826710 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.976712 May 27 15:15:08.049489 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 24/65] 10.222.0.50 () {62 vars in 1187 bytes} [Fri May 27 15:15:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 15:15:08.061243 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-1108a0b5-d3fc-4851-9dad-e583aaed72ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:08.061870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-1108a0b5-d3fc-4851-9dad-e583aaed72ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:08.165191 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-bbb943a0-a493-4d7f-bbd8-ac2067b74e44 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:08.165817 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-bbb943a0-a493-4d7f-bbd8-ac2067b74e44 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:08.193490 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bbb943a0-a493-4d7f-bbd8-ac2067b74e44 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:08.196774 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bbb943a0-a493-4d7f-bbd8-ac2067b74e44 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:08.197602 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bbb943a0-a493-4d7f-bbd8-ac2067b74e44 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:08.198052 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bbb943a0-a493-4d7f-bbd8-ac2067b74e44 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:08.244538 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-1108a0b5-d3fc-4851-9dad-e583aaed72ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:08.262662 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-1108a0b5-d3fc-4851-9dad-e583aaed72ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:08.266454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-1108a0b5-d3fc-4851-9dad-e583aaed72ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:08.269859 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-1108a0b5-d3fc-4851-9dad-e583aaed72ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1281 microversion: 2.20 time: 0.212719 May 27 15:15:08.271071 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 42/66] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:15:08 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1281 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:08.287520 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-00cc7dd2-eb64-4368-8bbb-250a46c32940 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:08.288465 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-00cc7dd2-eb64-4368-8bbb-250a46c32940 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:08.298040 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-00cc7dd2-eb64-4368-8bbb-250a46c32940 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:08.298692 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-00cc7dd2-eb64-4368-8bbb-250a46c32940 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:08.300032 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-00cc7dd2-eb64-4368-8bbb-250a46c32940 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:08.309226 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-00cc7dd2-eb64-4368-8bbb-250a46c32940 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:08.483357 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-00cc7dd2-eb64-4368-8bbb-250a46c32940 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:08.495093 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-00cc7dd2-eb64-4368-8bbb-250a46c32940 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1242 microversion: 2.1 time: 0.213316 May 27 15:15:08.500387 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 43/67] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:08 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1242 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:08.543926 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-bbb943a0-a493-4d7f-bbd8-ac2067b74e44 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:08.552304 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-bbb943a0-a493-4d7f-bbd8-ac2067b74e44 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1314 microversion: 2.1 time: 0.391357 May 27 15:15:08.555291 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 25/68] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:08 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:09.290020 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8d1f020c-b3bc-45b0-b962-6739f5e04919 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:09.291322 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-8d1f020c-b3bc-45b0-b962-6739f5e04919 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:09.303505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8d1f020c-b3bc-45b0-b962-6739f5e04919 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:09.303962 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8d1f020c-b3bc-45b0-b962-6739f5e04919 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:09.304746 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8d1f020c-b3bc-45b0-b962-6739f5e04919 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:09.305286 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8d1f020c-b3bc-45b0-b962-6739f5e04919 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:09.378212 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-8d1f020c-b3bc-45b0-b962-6739f5e04919 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:09.389459 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-8d1f020c-b3bc-45b0-b962-6739f5e04919 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:09.391012 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-8d1f020c-b3bc-45b0-b962-6739f5e04919 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:09.392246 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-8d1f020c-b3bc-45b0-b962-6739f5e04919 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1285 microversion: 2.20 time: 0.106782 May 27 15:15:09.392679 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 44/69] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:15:09 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:09.518565 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-2d123293-ae5c-4c19-8f8e-d458dc13b69f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:09.519325 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-2d123293-ae5c-4c19-8f8e-d458dc13b69f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:09.527427 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2d123293-ae5c-4c19-8f8e-d458dc13b69f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:09.528689 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2d123293-ae5c-4c19-8f8e-d458dc13b69f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:09.530329 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2d123293-ae5c-4c19-8f8e-d458dc13b69f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:09.531016 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2d123293-ae5c-4c19-8f8e-d458dc13b69f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:09.575295 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-3e154222-9d1a-4657-866f-0c0611dd324f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:09.576100 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-3e154222-9d1a-4657-866f-0c0611dd324f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:09.591527 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3e154222-9d1a-4657-866f-0c0611dd324f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:09.595551 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3e154222-9d1a-4657-866f-0c0611dd324f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:09.596663 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3e154222-9d1a-4657-866f-0c0611dd324f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:09.599391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3e154222-9d1a-4657-866f-0c0611dd324f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:09.667303 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-2d123293-ae5c-4c19-8f8e-d458dc13b69f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:09.679687 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-2d123293-ae5c-4c19-8f8e-d458dc13b69f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1242 microversion: 2.1 time: 0.165017 May 27 15:15:09.681119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 26/70] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:09 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1242 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:09.895181 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-3e154222-9d1a-4657-866f-0c0611dd324f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:09.906280 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-3e154222-9d1a-4657-866f-0c0611dd324f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1314 microversion: 2.1 time: 0.337842 May 27 15:15:09.908687 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 45/71] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:09 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:10.412532 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-11ada322-8d09-433a-88ba-4563bfa9e23b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:10.413152 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-11ada322-8d09-433a-88ba-4563bfa9e23b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:10.417122 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=9 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:10.432257 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-11ada322-8d09-433a-88ba-4563bfa9e23b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:10.433727 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-11ada322-8d09-433a-88ba-4563bfa9e23b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:10.438044 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-11ada322-8d09-433a-88ba-4563bfa9e23b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:10.439103 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-11ada322-8d09-433a-88ba-4563bfa9e23b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:10.449733 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=53 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:10.627378 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-11ada322-8d09-433a-88ba-4563bfa9e23b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:10.640618 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-11ada322-8d09-433a-88ba-4563bfa9e23b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:10.653071 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-11ada322-8d09-433a-88ba-4563bfa9e23b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:10.658838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-11ada322-8d09-433a-88ba-4563bfa9e23b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1341 microversion: 2.20 time: 0.246987 May 27 15:15:10.659564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 27/72] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:15:10 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1341 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:10.697806 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-642c65c2-48c4-48eb-baa0-c1a7046c3b67 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:10.698465 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-642c65c2-48c4-48eb-baa0-c1a7046c3b67 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:10.715047 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=2 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:10.716696 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-642c65c2-48c4-48eb-baa0-c1a7046c3b67 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:10.720099 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-642c65c2-48c4-48eb-baa0-c1a7046c3b67 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:10.727672 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-642c65c2-48c4-48eb-baa0-c1a7046c3b67 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:10.728923 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-642c65c2-48c4-48eb-baa0-c1a7046c3b67 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:10.752362 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=55 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:10.927535 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d8acf986-e434-4ace-a207-4f2d43ca13eb tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:10.930793 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-d8acf986-e434-4ace-a207-4f2d43ca13eb tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:10.949034 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d8acf986-e434-4ace-a207-4f2d43ca13eb tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:10.950585 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d8acf986-e434-4ace-a207-4f2d43ca13eb tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:10.952359 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d8acf986-e434-4ace-a207-4f2d43ca13eb tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:10.953490 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d8acf986-e434-4ace-a207-4f2d43ca13eb tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:10.970801 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-642c65c2-48c4-48eb-baa0-c1a7046c3b67 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:10.981733 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-642c65c2-48c4-48eb-baa0-c1a7046c3b67 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1298 microversion: 2.1 time: 0.286192 May 27 15:15:10.984283 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 46/73] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:10 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1298 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:11.317327 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d8acf986-e434-4ace-a207-4f2d43ca13eb tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:11.339845 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-d8acf986-e434-4ace-a207-4f2d43ca13eb tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1314 microversion: 2.1 time: 0.417524 May 27 15:15:11.341268 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 28/74] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:10 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:11.677709 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-3f796efd-7cb7-4743-8364-c5a90e695036 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:11.678313 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-3f796efd-7cb7-4743-8364-c5a90e695036 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:11.697632 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3f796efd-7cb7-4743-8364-c5a90e695036 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:11.698083 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3f796efd-7cb7-4743-8364-c5a90e695036 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:11.699442 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3f796efd-7cb7-4743-8364-c5a90e695036 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:11.699881 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3f796efd-7cb7-4743-8364-c5a90e695036 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:11.806750 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-3f796efd-7cb7-4743-8364-c5a90e695036 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:11.819928 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-3f796efd-7cb7-4743-8364-c5a90e695036 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:11.822338 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-3f796efd-7cb7-4743-8364-c5a90e695036 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:11.825560 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-3f796efd-7cb7-4743-8364-c5a90e695036 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1339 microversion: 2.20 time: 0.151927 May 27 15:15:11.837758 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 47/75] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:15:11 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1339 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:12.003000 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-5675ab53-a9b2-4590-86f5-a3fafcb8a83a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:12.004224 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-5675ab53-a9b2-4590-86f5-a3fafcb8a83a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:12.012435 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5675ab53-a9b2-4590-86f5-a3fafcb8a83a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:12.013568 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5675ab53-a9b2-4590-86f5-a3fafcb8a83a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:12.014634 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5675ab53-a9b2-4590-86f5-a3fafcb8a83a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:12.016620 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5675ab53-a9b2-4590-86f5-a3fafcb8a83a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:12.133296 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5675ab53-a9b2-4590-86f5-a3fafcb8a83a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:12.168231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-5675ab53-a9b2-4590-86f5-a3fafcb8a83a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1296 microversion: 2.1 time: 0.169304 May 27 15:15:12.169481 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 48/76] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:11 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1296 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:12.359182 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-66dc1a47-6465-48aa-89e3-776905658752 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:12.359924 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-66dc1a47-6465-48aa-89e3-776905658752 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:12.367870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-66dc1a47-6465-48aa-89e3-776905658752 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:12.371473 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-66dc1a47-6465-48aa-89e3-776905658752 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:12.372396 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-66dc1a47-6465-48aa-89e3-776905658752 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:12.373198 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-66dc1a47-6465-48aa-89e3-776905658752 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:12.378111 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-a6fdb22a-c90e-4b42-afca-666563e5d3e4 req-5b327d11-05f2-4f30-a441-b826cfb5d7fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b8928d-e849-4c12-b900-e0bfa48a1679", "name": "network-vif-plugged", "status": "completed", "tag": "ef128789-5dc1-48ac-aba6-775115b05e14"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:12.395388 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-a6fdb22a-c90e-4b42-afca-666563e5d3e4 req-5b327d11-05f2-4f30-a441-b826cfb5d7fa service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:12.396151 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-a6fdb22a-c90e-4b42-afca-666563e5d3e4 req-5b327d11-05f2-4f30-a441-b826cfb5d7fa service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:12.420058 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-a6fdb22a-c90e-4b42-afca-666563e5d3e4 req-5b327d11-05f2-4f30-a441-b826cfb5d7fa service nova] Creating event network-vif-plugged:ef128789-5dc1-48ac-aba6-775115b05e14 for instance 15b8928d-e849-4c12-b900-e0bfa48a1679 on hv-cinder-84254 May 27 15:15:12.431401 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-a6fdb22a-c90e-4b42-afca-666563e5d3e4 req-5b327d11-05f2-4f30-a441-b826cfb5d7fa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.444269 May 27 15:15:12.435334 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 29/77] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:12.585207 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-66dc1a47-6465-48aa-89e3-776905658752 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:12.593427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-66dc1a47-6465-48aa-89e3-776905658752 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1314 microversion: 2.1 time: 0.239473 May 27 15:15:12.593995 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 49/78] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:12 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:12.845566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-bdae5f1b-ebef-4f29-8d1f-16fb39317c9c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:12.846262 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-bdae5f1b-ebef-4f29-8d1f-16fb39317c9c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:12.852543 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bdae5f1b-ebef-4f29-8d1f-16fb39317c9c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:12.852998 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bdae5f1b-ebef-4f29-8d1f-16fb39317c9c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:12.853765 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bdae5f1b-ebef-4f29-8d1f-16fb39317c9c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:12.854246 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bdae5f1b-ebef-4f29-8d1f-16fb39317c9c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:13.005266 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-bdae5f1b-ebef-4f29-8d1f-16fb39317c9c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:13.019235 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-bdae5f1b-ebef-4f29-8d1f-16fb39317c9c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:13.028781 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-bdae5f1b-ebef-4f29-8d1f-16fb39317c9c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:13.030116 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-bdae5f1b-ebef-4f29-8d1f-16fb39317c9c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1406 microversion: 2.20 time: 0.189275 May 27 15:15:13.044674 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 30/79] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:15:12 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:13.186370 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-23d1cb49-6b4d-433b-b84a-c2ade0826866 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:13.187006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-23d1cb49-6b4d-433b-b84a-c2ade0826866 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:13.195382 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-23d1cb49-6b4d-433b-b84a-c2ade0826866 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:13.195916 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-23d1cb49-6b4d-433b-b84a-c2ade0826866 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:13.196909 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-23d1cb49-6b4d-433b-b84a-c2ade0826866 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:13.197541 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-23d1cb49-6b4d-433b-b84a-c2ade0826866 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:13.269048 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-23d1cb49-6b4d-433b-b84a-c2ade0826866 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:13.277376 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-23d1cb49-6b4d-433b-b84a-c2ade0826866 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1296 microversion: 2.1 time: 0.094916 May 27 15:15:13.280510 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 50/80] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:13 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1296 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:13.610418 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-c248e361-6deb-400a-92bc-a4b2819c6c88 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:13.611059 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-c248e361-6deb-400a-92bc-a4b2819c6c88 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:13.617131 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c248e361-6deb-400a-92bc-a4b2819c6c88 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:13.617588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c248e361-6deb-400a-92bc-a4b2819c6c88 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:13.618357 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c248e361-6deb-400a-92bc-a4b2819c6c88 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:13.618798 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c248e361-6deb-400a-92bc-a4b2819c6c88 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:13.757884 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-c248e361-6deb-400a-92bc-a4b2819c6c88 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:13.765753 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-c248e361-6deb-400a-92bc-a4b2819c6c88 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1314 microversion: 2.1 time: 0.159351 May 27 15:15:13.766333 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 31/81] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:13 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:14.048796 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-2d50899b-fd69-48c3-a140-bfce3f5bb92b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:14.049392 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-2d50899b-fd69-48c3-a140-bfce3f5bb92b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:14.056053 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2d50899b-fd69-48c3-a140-bfce3f5bb92b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:14.056576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2d50899b-fd69-48c3-a140-bfce3f5bb92b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:14.057415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2d50899b-fd69-48c3-a140-bfce3f5bb92b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:14.057954 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2d50899b-fd69-48c3-a140-bfce3f5bb92b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:14.285667 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-2d50899b-fd69-48c3-a140-bfce3f5bb92b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:14.296882 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-2d50899b-fd69-48c3-a140-bfce3f5bb92b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:14.297840 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-0e1156ac-cb35-4e80-aefc-7515b4a3ee2c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:14.298567 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-0e1156ac-cb35-4e80-aefc-7515b4a3ee2c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:14.301690 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-2d50899b-fd69-48c3-a140-bfce3f5bb92b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:14.305696 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-2d50899b-fd69-48c3-a140-bfce3f5bb92b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1406 microversion: 2.20 time: 0.260653 May 27 15:15:14.307235 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 51/82] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:15:14 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1406 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:14.320246 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0e1156ac-cb35-4e80-aefc-7515b4a3ee2c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:14.320964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0e1156ac-cb35-4e80-aefc-7515b4a3ee2c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:14.322003 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0e1156ac-cb35-4e80-aefc-7515b4a3ee2c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:14.322896 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0e1156ac-cb35-4e80-aefc-7515b4a3ee2c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:14.437186 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-0e1156ac-cb35-4e80-aefc-7515b4a3ee2c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:14.446069 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-0e1156ac-cb35-4e80-aefc-7515b4a3ee2c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1296 microversion: 2.1 time: 0.153377 May 27 15:15:14.447812 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 32/83] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:14 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1296 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:14.783107 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-6c9b5696-bdf9-4dcd-bf20-0743d406f6c4 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:14.784164 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-6c9b5696-bdf9-4dcd-bf20-0743d406f6c4 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:14.802402 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6c9b5696-bdf9-4dcd-bf20-0743d406f6c4 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:14.802864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6c9b5696-bdf9-4dcd-bf20-0743d406f6c4 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:14.803640 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6c9b5696-bdf9-4dcd-bf20-0743d406f6c4 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:14.804067 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6c9b5696-bdf9-4dcd-bf20-0743d406f6c4 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:15.331452 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-3370bc10-535b-4bd2-b7e9-9312b7706da5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:15.332091 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-3370bc10-535b-4bd2-b7e9-9312b7706da5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:15.353531 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3370bc10-535b-4bd2-b7e9-9312b7706da5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:15.355988 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3370bc10-535b-4bd2-b7e9-9312b7706da5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:15.361448 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3370bc10-535b-4bd2-b7e9-9312b7706da5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:15.362797 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3370bc10-535b-4bd2-b7e9-9312b7706da5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:15.442017 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6c9b5696-bdf9-4dcd-bf20-0743d406f6c4 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:15.463657 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-6c9b5696-bdf9-4dcd-bf20-0743d406f6c4 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1314 microversion: 2.1 time: 0.682592 May 27 15:15:15.467733 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 52/84] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:14 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1314 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:15.478760 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-5eb4664e-75f4-4932-9f84-79e3934436c0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:15.486549 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-5eb4664e-75f4-4932-9f84-79e3934436c0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:15.494226 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5eb4664e-75f4-4932-9f84-79e3934436c0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:15.494682 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5eb4664e-75f4-4932-9f84-79e3934436c0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:15.501189 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5eb4664e-75f4-4932-9f84-79e3934436c0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:15.501648 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5eb4664e-75f4-4932-9f84-79e3934436c0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:15.915154 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5eb4664e-75f4-4932-9f84-79e3934436c0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:15.918606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-3370bc10-535b-4bd2-b7e9-9312b7706da5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:15.937717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-5eb4664e-75f4-4932-9f84-79e3934436c0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1364 microversion: 2.1 time: 0.468557 May 27 15:15:15.941038 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 53/85] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:15 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1364 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:15.942787 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-3370bc10-535b-4bd2-b7e9-9312b7706da5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:15.944714 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-3370bc10-535b-4bd2-b7e9-9312b7706da5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:15.947024 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-3370bc10-535b-4bd2-b7e9-9312b7706da5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1406 microversion: 2.20 time: 0.624152 May 27 15:15:15.949048 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 33/86] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:15:15 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1406 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:15.954096 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-fd943817-cffa-4dc9-bf36-bdcebfbbcad2 req-c6b2a8b0-630d-4ab8-8aae-fe6732261823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b88bbd4b-d173-4df5-9e19-4fedb81b4aed", "tag": "b65a7130-71a7-4267-9201-c07ec8e83b00"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:15.993177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-fd943817-cffa-4dc9-bf36-bdcebfbbcad2 req-c6b2a8b0-630d-4ab8-8aae-fe6732261823 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:15.994600 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-fd943817-cffa-4dc9-bf36-bdcebfbbcad2 req-c6b2a8b0-630d-4ab8-8aae-fe6732261823 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:16.042633 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-fd943817-cffa-4dc9-bf36-bdcebfbbcad2 req-c6b2a8b0-630d-4ab8-8aae-fe6732261823 service nova] Creating event network-changed:b65a7130-71a7-4267-9201-c07ec8e83b00 for instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed on hv-cinder-84254 May 27 15:15:16.043746 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-fd943817-cffa-4dc9-bf36-bdcebfbbcad2 req-c6b2a8b0-630d-4ab8-8aae-fe6732261823 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117742) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 15:15:16.046433 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4a3ca566-3685-4caa-aee7-427b3d744efd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:16.047112 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4a3ca566-3685-4caa-aee7-427b3d744efd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:16.049253 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4a3ca566-3685-4caa-aee7-427b3d744efd None None] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:16.051252 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4a3ca566-3685-4caa-aee7-427b3d744efd None None] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:16.080850 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.compute.rpcapi [None req-4a3ca566-3685-4caa-aee7-427b3d744efd None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 27 15:15:16.082415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4a3ca566-3685-4caa-aee7-427b3d744efd None None] Releasing lock "compute-rpcapi-router" {{(pid=117742) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 15:15:16.133744 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-4a3ca566-3685-4caa-aee7-427b3d744efd None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183187 May 27 15:15:16.134726 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 54/87] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:16.482523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-51f75c35-3240-4501-8ab8-39e613211cbb tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:16.483647 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-51f75c35-3240-4501-8ab8-39e613211cbb tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:16.497791 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-51f75c35-3240-4501-8ab8-39e613211cbb tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:16.499531 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-51f75c35-3240-4501-8ab8-39e613211cbb tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:16.501967 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-51f75c35-3240-4501-8ab8-39e613211cbb tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:16.502429 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-51f75c35-3240-4501-8ab8-39e613211cbb tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:16.962902 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-6b74addc-9def-40e6-9bdc-28648a8f7430 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:16.965203 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-6b74addc-9def-40e6-9bdc-28648a8f7430 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:16.983221 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6b74addc-9def-40e6-9bdc-28648a8f7430 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:16.984972 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6b74addc-9def-40e6-9bdc-28648a8f7430 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:16.987927 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6b74addc-9def-40e6-9bdc-28648a8f7430 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:16.991283 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6b74addc-9def-40e6-9bdc-28648a8f7430 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:17.009765 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-51f75c35-3240-4501-8ab8-39e613211cbb tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:17.023831 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-51f75c35-3240-4501-8ab8-39e613211cbb tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1314 microversion: 2.1 time: 0.545929 May 27 15:15:17.027698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 34/88] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:16 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:17.048706 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-213ae788-f30e-46e5-9b2e-3b6742f0fca8 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:17.050576 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-213ae788-f30e-46e5-9b2e-3b6742f0fca8 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:17.064812 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-213ae788-f30e-46e5-9b2e-3b6742f0fca8 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:17.066157 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-213ae788-f30e-46e5-9b2e-3b6742f0fca8 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:17.067192 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-213ae788-f30e-46e5-9b2e-3b6742f0fca8 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:17.067827 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-213ae788-f30e-46e5-9b2e-3b6742f0fca8 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:17.337783 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-213ae788-f30e-46e5-9b2e-3b6742f0fca8 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:17.340098 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6b74addc-9def-40e6-9bdc-28648a8f7430 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:17.347715 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-213ae788-f30e-46e5-9b2e-3b6742f0fca8 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:17.349525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-213ae788-f30e-46e5-9b2e-3b6742f0fca8 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:17.350228 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-6b74addc-9def-40e6-9bdc-28648a8f7430 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1364 microversion: 2.1 time: 0.398221 May 27 15:15:17.351058 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-213ae788-f30e-46e5-9b2e-3b6742f0fca8 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1406 microversion: 2.20 time: 0.321881 May 27 15:15:17.362394 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 35/90] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:15:17 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1406 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:17.362601 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 55/90] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:16 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1364 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:17.479781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-432ee2f4-74c7-4cb7-a8dd-481fba5ab8a0 req-0d8bbff7-af6b-42c7-ad97-207ad24c6a6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f61fd2c2-bca4-412d-93c3-5a3aee3a3b27", "tag": "8aadec0a-6b37-4955-aa4d-147789e9560f"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:17.495756 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-432ee2f4-74c7-4cb7-a8dd-481fba5ab8a0 req-0d8bbff7-af6b-42c7-ad97-207ad24c6a6f service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:17.497559 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-432ee2f4-74c7-4cb7-a8dd-481fba5ab8a0 req-0d8bbff7-af6b-42c7-ad97-207ad24c6a6f service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:17.513851 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-432ee2f4-74c7-4cb7-a8dd-481fba5ab8a0 req-0d8bbff7-af6b-42c7-ad97-207ad24c6a6f service nova] Creating event network-changed:8aadec0a-6b37-4955-aa4d-147789e9560f for instance f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 on hv-cinder-84254 May 27 15:15:17.520418 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-432ee2f4-74c7-4cb7-a8dd-481fba5ab8a0 req-0d8bbff7-af6b-42c7-ad97-207ad24c6a6f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156453 May 27 15:15:17.521154 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 56/91] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:18.045272 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-273f11ba-1c7f-4a84-ab9f-ddf9ee58bb8f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:18.046986 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-273f11ba-1c7f-4a84-ab9f-ddf9ee58bb8f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:18.055357 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=6 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:18.056455 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=12 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:18.059332 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-273f11ba-1c7f-4a84-ab9f-ddf9ee58bb8f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:18.060102 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-273f11ba-1c7f-4a84-ab9f-ddf9ee58bb8f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:18.061451 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-273f11ba-1c7f-4a84-ab9f-ddf9ee58bb8f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:18.062303 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-273f11ba-1c7f-4a84-ab9f-ddf9ee58bb8f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:18.350450 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-273f11ba-1c7f-4a84-ab9f-ddf9ee58bb8f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:18.360026 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-273f11ba-1c7f-4a84-ab9f-ddf9ee58bb8f tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1501 microversion: 2.1 time: 0.321036 May 27 15:15:18.380627 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-c98fe987-3dfc-4dae-a330-809b26d3562e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:18.382343 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-c98fe987-3dfc-4dae-a330-809b26d3562e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:18.383252 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 36/92] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:18 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1501 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:18.387210 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=12 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:18.388623 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-3893a272-5835-428f-a27d-a8ea88a49e78 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:18.389734 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-3893a272-5835-428f-a27d-a8ea88a49e78 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:18.398842 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c98fe987-3dfc-4dae-a330-809b26d3562e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:18.399320 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c98fe987-3dfc-4dae-a330-809b26d3562e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:18.406053 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c98fe987-3dfc-4dae-a330-809b26d3562e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:18.406758 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c98fe987-3dfc-4dae-a330-809b26d3562e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:18.408986 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3893a272-5835-428f-a27d-a8ea88a49e78 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:18.409446 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3893a272-5835-428f-a27d-a8ea88a49e78 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:18.410270 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3893a272-5835-428f-a27d-a8ea88a49e78 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:18.410724 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3893a272-5835-428f-a27d-a8ea88a49e78 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:18.976818 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-3893a272-5835-428f-a27d-a8ea88a49e78 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:18.996373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-3893a272-5835-428f-a27d-a8ea88a49e78 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1364 microversion: 2.1 time: 0.611929 May 27 15:15:18.999301 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 37/93] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:18 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1364 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:19.067212 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-c98fe987-3dfc-4dae-a330-809b26d3562e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:19.086327 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-c98fe987-3dfc-4dae-a330-809b26d3562e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:19.088080 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-c98fe987-3dfc-4dae-a330-809b26d3562e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:19.090830 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-c98fe987-3dfc-4dae-a330-809b26d3562e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1406 microversion: 2.20 time: 0.715772 May 27 15:15:19.092065 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 57/94] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:15:18 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1406 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:19.989080 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-2ff68b43-817f-4a8d-838c-8d0d67ce5086 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a72bce98-b770-47e5-878c-a002c4524ae5"}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:19.989696 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-2ff68b43-817f-4a8d-838c-8d0d67ce5086 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:19.996012 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2ff68b43-817f-4a8d-838c-8d0d67ce5086 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:19.996464 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2ff68b43-817f-4a8d-838c-8d0d67ce5086 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:19.997238 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2ff68b43-817f-4a8d-838c-8d0d67ce5086 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:19.997677 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2ff68b43-817f-4a8d-838c-8d0d67ce5086 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:20.014080 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-72fa2446-c2f3-46c6-9f50-f92b56dd4bc8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:20.014772 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-72fa2446-c2f3-46c6-9f50-f92b56dd4bc8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:20.032255 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-72fa2446-c2f3-46c6-9f50-f92b56dd4bc8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:20.033028 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-72fa2446-c2f3-46c6-9f50-f92b56dd4bc8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:20.034160 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-72fa2446-c2f3-46c6-9f50-f92b56dd4bc8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:20.034603 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-72fa2446-c2f3-46c6-9f50-f92b56dd4bc8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:20.355831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-72fa2446-c2f3-46c6-9f50-f92b56dd4bc8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:20.384526 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-72fa2446-c2f3-46c6-9f50-f92b56dd4bc8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1364 microversion: 2.1 time: 0.374491 May 27 15:15:20.401927 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 58/95] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:20 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1364 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:20.419002 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-5ca1b947-53fd-4f75-a8a5-2cc82a24a430 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:20.420727 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-5ca1b947-53fd-4f75-a8a5-2cc82a24a430 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:20.434965 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5ca1b947-53fd-4f75-a8a5-2cc82a24a430 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:20.435437 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5ca1b947-53fd-4f75-a8a5-2cc82a24a430 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:20.436185 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5ca1b947-53fd-4f75-a8a5-2cc82a24a430 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:20.436623 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5ca1b947-53fd-4f75-a8a5-2cc82a24a430 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:20.583767 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-2ff68b43-817f-4a8d-838c-8d0d67ce5086 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "POST /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.598897 May 27 15:15:20.585272 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 38/96] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 15:15:19 2022] POST /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679/os-volume_attachments => generated 194 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:20.723681 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5ca1b947-53fd-4f75-a8a5-2cc82a24a430 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:20.733266 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5ca1b947-53fd-4f75-a8a5-2cc82a24a430 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:20.736166 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5ca1b947-53fd-4f75-a8a5-2cc82a24a430 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:20.737301 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-5ca1b947-53fd-4f75-a8a5-2cc82a24a430 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1406 microversion: 2.20 time: 0.332670 May 27 15:15:20.738199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 59/97] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:15:20 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1406 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:21.407987 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-554e1830-1656-4529-a7a9-a7b3ceac9afd tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:21.408963 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-554e1830-1656-4529-a7a9-a7b3ceac9afd tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:21.429383 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-554e1830-1656-4529-a7a9-a7b3ceac9afd tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:21.434789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-554e1830-1656-4529-a7a9-a7b3ceac9afd tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:21.438221 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-554e1830-1656-4529-a7a9-a7b3ceac9afd tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:21.438692 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-554e1830-1656-4529-a7a9-a7b3ceac9afd tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:21.757019 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f8101075-354f-4759-9e68-907725dfd186 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:21.758431 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f8101075-354f-4759-9e68-907725dfd186 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:21.768793 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f8101075-354f-4759-9e68-907725dfd186 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:21.769241 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f8101075-354f-4759-9e68-907725dfd186 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:21.771146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f8101075-354f-4759-9e68-907725dfd186 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:21.773197 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f8101075-354f-4759-9e68-907725dfd186 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:21.882189 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-554e1830-1656-4529-a7a9-a7b3ceac9afd tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:21.897959 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-554e1830-1656-4529-a7a9-a7b3ceac9afd tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1364 microversion: 2.1 time: 0.495102 May 27 15:15:21.900311 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 39/98] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:21 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1364 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:22.115896 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f8101075-354f-4759-9e68-907725dfd186 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:22.130920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f8101075-354f-4759-9e68-907725dfd186 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:22.132753 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f8101075-354f-4759-9e68-907725dfd186 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:22.133876 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f8101075-354f-4759-9e68-907725dfd186 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1406 microversion: 2.20 time: 0.380665 May 27 15:15:22.139070 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 60/99] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:15:21 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1406 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:15:22.919352 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-c832ed19-e1bf-4ca9-95a1-bd60e4c184f2 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:22.921796 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-c832ed19-e1bf-4ca9-95a1-bd60e4c184f2 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:22.937156 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c832ed19-e1bf-4ca9-95a1-bd60e4c184f2 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:22.937822 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c832ed19-e1bf-4ca9-95a1-bd60e4c184f2 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:22.938587 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c832ed19-e1bf-4ca9-95a1-bd60e4c184f2 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:22.939809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c832ed19-e1bf-4ca9-95a1-bd60e4c184f2 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:23.112539 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-c832ed19-e1bf-4ca9-95a1-bd60e4c184f2 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:23.121192 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-c832ed19-e1bf-4ca9-95a1-bd60e4c184f2 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1364 microversion: 2.1 time: 0.208657 May 27 15:15:23.124111 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 40/100] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:22 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:23.168516 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-82d5bee3-b30d-4942-a75e-6cf0250d7ebe tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:23.169209 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-82d5bee3-b30d-4942-a75e-6cf0250d7ebe tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:23.179990 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-82d5bee3-b30d-4942-a75e-6cf0250d7ebe tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:23.181364 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-82d5bee3-b30d-4942-a75e-6cf0250d7ebe tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:23.185321 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-82d5bee3-b30d-4942-a75e-6cf0250d7ebe tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:23.185321 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-82d5bee3-b30d-4942-a75e-6cf0250d7ebe tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:23.376079 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-82d5bee3-b30d-4942-a75e-6cf0250d7ebe tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:23.387899 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-82d5bee3-b30d-4942-a75e-6cf0250d7ebe tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:23.389758 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-82d5bee3-b30d-4942-a75e-6cf0250d7ebe tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:23.391324 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-82d5bee3-b30d-4942-a75e-6cf0250d7ebe tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1406 microversion: 2.20 time: 0.230163 May 27 15:15:23.392914 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 61/101] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:15:23 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:23.785636 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-339eae03-067f-4185-8104-a6531ebdf52d req-a38bec24-fb36-484a-9013-2b05f43c84f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88bbd4b-d173-4df5-9e19-4fedb81b4aed", "name": "network-vif-plugged", "status": "completed", "tag": "b65a7130-71a7-4267-9201-c07ec8e83b00"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:23.798266 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-339eae03-067f-4185-8104-a6531ebdf52d req-a38bec24-fb36-484a-9013-2b05f43c84f8 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:23.803599 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-339eae03-067f-4185-8104-a6531ebdf52d req-a38bec24-fb36-484a-9013-2b05f43c84f8 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:23.852565 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-339eae03-067f-4185-8104-a6531ebdf52d req-a38bec24-fb36-484a-9013-2b05f43c84f8 service nova] Creating event network-vif-plugged:b65a7130-71a7-4267-9201-c07ec8e83b00 for instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed on hv-cinder-84254 May 27 15:15:23.880158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-339eae03-067f-4185-8104-a6531ebdf52d req-a38bec24-fb36-484a-9013-2b05f43c84f8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101343 May 27 15:15:23.880688 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 41/102] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:24.141298 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-68c8eb95-2140-4540-87be-7b3b74beb4be tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:24.142070 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-68c8eb95-2140-4540-87be-7b3b74beb4be tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:24.159488 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-68c8eb95-2140-4540-87be-7b3b74beb4be tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:24.160882 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-68c8eb95-2140-4540-87be-7b3b74beb4be tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:24.165012 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-68c8eb95-2140-4540-87be-7b3b74beb4be tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:24.165644 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-68c8eb95-2140-4540-87be-7b3b74beb4be tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:24.398644 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-68c8eb95-2140-4540-87be-7b3b74beb4be tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:24.406757 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-68c8eb95-2140-4540-87be-7b3b74beb4be tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1364 microversion: 2.1 time: 0.269969 May 27 15:15:24.407646 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 62/103] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:24 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1364 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:24.420307 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b951eccd-6592-484b-a2a4-4ca23d635145 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:24.422389 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b951eccd-6592-484b-a2a4-4ca23d635145 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:24.437622 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b951eccd-6592-484b-a2a4-4ca23d635145 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:24.438509 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b951eccd-6592-484b-a2a4-4ca23d635145 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:24.439501 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b951eccd-6592-484b-a2a4-4ca23d635145 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:24.440174 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b951eccd-6592-484b-a2a4-4ca23d635145 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:24.597916 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b951eccd-6592-484b-a2a4-4ca23d635145 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:24.610569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b951eccd-6592-484b-a2a4-4ca23d635145 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:24.613591 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b951eccd-6592-484b-a2a4-4ca23d635145 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:24.614919 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b951eccd-6592-484b-a2a4-4ca23d635145 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1406 microversion: 2.20 time: 0.206652 May 27 15:15:24.616443 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 42/104] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:15:24 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:15:25.425426 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-258b6b94-796e-45d7-80d5-b49052ac4247 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:25.428495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-258b6b94-796e-45d7-80d5-b49052ac4247 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:25.438366 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-258b6b94-796e-45d7-80d5-b49052ac4247 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:25.439816 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-258b6b94-796e-45d7-80d5-b49052ac4247 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:25.440746 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-258b6b94-796e-45d7-80d5-b49052ac4247 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:25.441342 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-258b6b94-796e-45d7-80d5-b49052ac4247 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:25.616719 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-258b6b94-796e-45d7-80d5-b49052ac4247 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:25.619574 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=100 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:25.629677 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-258b6b94-796e-45d7-80d5-b49052ac4247 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1364 microversion: 2.1 time: 0.209007 May 27 15:15:25.630766 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 63/105] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:25 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:25.633529 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-57d5ccff-6eed-4217-8e0b-5bdf96afcbd2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:25.634153 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-57d5ccff-6eed-4217-8e0b-5bdf96afcbd2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:25.641081 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-57d5ccff-6eed-4217-8e0b-5bdf96afcbd2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:25.641486 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-57d5ccff-6eed-4217-8e0b-5bdf96afcbd2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:25.642483 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-57d5ccff-6eed-4217-8e0b-5bdf96afcbd2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:25.642891 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-57d5ccff-6eed-4217-8e0b-5bdf96afcbd2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:25.815156 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-57d5ccff-6eed-4217-8e0b-5bdf96afcbd2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:25.817877 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:25.831497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-57d5ccff-6eed-4217-8e0b-5bdf96afcbd2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:25.833612 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-57d5ccff-6eed-4217-8e0b-5bdf96afcbd2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:25.835603 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-57d5ccff-6eed-4217-8e0b-5bdf96afcbd2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1406 microversion: 2.20 time: 0.205806 May 27 15:15:25.836537 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 43/106] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:15:25 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:15:25.933183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-acac728e-37dd-4ef3-8f06-8803413611e2 req-565d70d5-923d-40a5-a1be-3dc1345c2f0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f61fd2c2-bca4-412d-93c3-5a3aee3a3b27", "name": "network-vif-plugged", "status": "completed", "tag": "8aadec0a-6b37-4955-aa4d-147789e9560f"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:25.956723 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-acac728e-37dd-4ef3-8f06-8803413611e2 req-565d70d5-923d-40a5-a1be-3dc1345c2f0e service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:25.957707 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-acac728e-37dd-4ef3-8f06-8803413611e2 req-565d70d5-923d-40a5-a1be-3dc1345c2f0e service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:25.979851 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-acac728e-37dd-4ef3-8f06-8803413611e2 req-565d70d5-923d-40a5-a1be-3dc1345c2f0e service nova] Creating event network-vif-plugged:8aadec0a-6b37-4955-aa4d-147789e9560f for instance f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 on hv-cinder-84254 May 27 15:15:25.986218 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-acac728e-37dd-4ef3-8f06-8803413611e2 req-565d70d5-923d-40a5-a1be-3dc1345c2f0e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059155 May 27 15:15:25.987494 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 64/107] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:26.655555 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-33db1a8a-76b1-4227-b3d2-6f5d2744cf0d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:26.655555 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-33db1a8a-76b1-4227-b3d2-6f5d2744cf0d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:26.657823 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-33db1a8a-76b1-4227-b3d2-6f5d2744cf0d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:26.658283 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-33db1a8a-76b1-4227-b3d2-6f5d2744cf0d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:26.659103 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-33db1a8a-76b1-4227-b3d2-6f5d2744cf0d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:26.659954 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-33db1a8a-76b1-4227-b3d2-6f5d2744cf0d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:26.808946 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-33db1a8a-76b1-4227-b3d2-6f5d2744cf0d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:26.819144 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-33db1a8a-76b1-4227-b3d2-6f5d2744cf0d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1364 microversion: 2.1 time: 0.175951 May 27 15:15:26.819742 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 44/108] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:26 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:26.856585 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-7d3cc471-06b5-4d04-aedc-1f18498c45e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:26.858504 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-7d3cc471-06b5-4d04-aedc-1f18498c45e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:26.862320 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=2 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:26.866670 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7d3cc471-06b5-4d04-aedc-1f18498c45e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:26.867144 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7d3cc471-06b5-4d04-aedc-1f18498c45e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:26.867908 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7d3cc471-06b5-4d04-aedc-1f18498c45e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:26.868342 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7d3cc471-06b5-4d04-aedc-1f18498c45e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:27.036046 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-7d3cc471-06b5-4d04-aedc-1f18498c45e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:27.045543 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-7d3cc471-06b5-4d04-aedc-1f18498c45e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:27.047070 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-7d3cc471-06b5-4d04-aedc-1f18498c45e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:27.048373 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-7d3cc471-06b5-4d04-aedc-1f18498c45e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1597 microversion: 2.20 time: 0.197835 May 27 15:15:27.048927 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 65/109] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:15:26 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1597 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:15:27.066785 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-4a6471b7-c1d5-4654-add8-5657d94cbe8a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:27.067297 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-4a6471b7-c1d5-4654-add8-5657d94cbe8a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:27.075730 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4a6471b7-c1d5-4654-add8-5657d94cbe8a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:27.076384 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4a6471b7-c1d5-4654-add8-5657d94cbe8a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:27.077368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4a6471b7-c1d5-4654-add8-5657d94cbe8a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:27.077811 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4a6471b7-c1d5-4654-add8-5657d94cbe8a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:27.527537 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-4a6471b7-c1d5-4654-add8-5657d94cbe8a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.464545 May 27 15:15:27.528134 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 45/110] 10.222.0.50 () {60 vars in 1315 bytes} [Fri May 27 15:15:27 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed/os-interface => generated 284 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:15:27.837275 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-0fa8024a-26c5-4e9a-b7bd-f505e4bbfeaf tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:27.838098 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-0fa8024a-26c5-4e9a-b7bd-f505e4bbfeaf tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:27.863149 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0fa8024a-26c5-4e9a-b7bd-f505e4bbfeaf tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:27.863773 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0fa8024a-26c5-4e9a-b7bd-f505e4bbfeaf tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:27.864375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0fa8024a-26c5-4e9a-b7bd-f505e4bbfeaf tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:27.864814 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0fa8024a-26c5-4e9a-b7bd-f505e4bbfeaf tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:28.231181 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-0fa8024a-26c5-4e9a-b7bd-f505e4bbfeaf tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:28.260151 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-0fa8024a-26c5-4e9a-b7bd-f505e4bbfeaf tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1364 microversion: 2.1 time: 0.426949 May 27 15:15:28.261421 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 66/111] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:27 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1364 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:29.280917 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-4f7f8a27-321f-4e63-bab0-20b080d5f1ff tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:29.282468 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-4f7f8a27-321f-4e63-bab0-20b080d5f1ff tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:29.290957 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4f7f8a27-321f-4e63-bab0-20b080d5f1ff tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:29.292561 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4f7f8a27-321f-4e63-bab0-20b080d5f1ff tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:29.293546 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4f7f8a27-321f-4e63-bab0-20b080d5f1ff tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:29.294166 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4f7f8a27-321f-4e63-bab0-20b080d5f1ff tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:29.445404 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-789f0d43-7dbc-41c6-90ec-75bf1ef0628e req-3f929202-1516-4014-97a6-15d67c494f2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b88bbd4b-d173-4df5-9e19-4fedb81b4aed", "tag": "b65a7130-71a7-4267-9201-c07ec8e83b00"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:29.455398 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-789f0d43-7dbc-41c6-90ec-75bf1ef0628e req-3f929202-1516-4014-97a6-15d67c494f2b service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:29.455921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-789f0d43-7dbc-41c6-90ec-75bf1ef0628e req-3f929202-1516-4014-97a6-15d67c494f2b service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:29.477097 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-789f0d43-7dbc-41c6-90ec-75bf1ef0628e req-3f929202-1516-4014-97a6-15d67c494f2b service nova] Creating event network-changed:b65a7130-71a7-4267-9201-c07ec8e83b00 for instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed on hv-cinder-84254 May 27 15:15:29.482752 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-789f0d43-7dbc-41c6-90ec-75bf1ef0628e req-3f929202-1516-4014-97a6-15d67c494f2b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040880 May 27 15:15:29.483766 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 67/112] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:29.544936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-4f7f8a27-321f-4e63-bab0-20b080d5f1ff tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:29.558126 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-4f7f8a27-321f-4e63-bab0-20b080d5f1ff tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1550 microversion: 2.1 time: 0.283870 May 27 15:15:29.567814 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 46/113] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:29 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1550 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:29.577692 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-95fe4bd8-29ab-414e-9cab-7a43c25aa0ea tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:29.578418 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-95fe4bd8-29ab-414e-9cab-7a43c25aa0ea tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:29.585885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-95fe4bd8-29ab-414e-9cab-7a43c25aa0ea tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:29.586354 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-95fe4bd8-29ab-414e-9cab-7a43c25aa0ea tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:29.587202 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-95fe4bd8-29ab-414e-9cab-7a43c25aa0ea tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:29.587665 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-95fe4bd8-29ab-414e-9cab-7a43c25aa0ea tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:29.752424 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-95fe4bd8-29ab-414e-9cab-7a43c25aa0ea tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.180358 May 27 15:15:29.755144 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 68/114] 10.222.0.50 () {58 vars in 1274 bytes} [Fri May 27 15:15:29 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:31.400257 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-bf1f846c-ce9b-402a-9d2c-804f40c3c0ab req-8532d9b3-af9f-46cb-a48f-5d193d808dbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f61fd2c2-bca4-412d-93c3-5a3aee3a3b27", "tag": "8aadec0a-6b37-4955-aa4d-147789e9560f"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:31.410809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-bf1f846c-ce9b-402a-9d2c-804f40c3c0ab req-8532d9b3-af9f-46cb-a48f-5d193d808dbc service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:31.411694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-bf1f846c-ce9b-402a-9d2c-804f40c3c0ab req-8532d9b3-af9f-46cb-a48f-5d193d808dbc service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:31.423958 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-bf1f846c-ce9b-402a-9d2c-804f40c3c0ab req-8532d9b3-af9f-46cb-a48f-5d193d808dbc service nova] Creating event network-changed:8aadec0a-6b37-4955-aa4d-147789e9560f for instance f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 on hv-cinder-84254 May 27 15:15:31.430329 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-bf1f846c-ce9b-402a-9d2c-804f40c3c0ab req-8532d9b3-af9f-46cb-a48f-5d193d808dbc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033978 May 27 15:15:31.431889 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 47/115] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:36.586226 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-0dc53524-2f86-4a34-a61d-e23a40cfea30 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:36.587492 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-0dc53524-2f86-4a34-a61d-e23a40cfea30 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:36.597824 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0dc53524-2f86-4a34-a61d-e23a40cfea30 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:36.598284 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0dc53524-2f86-4a34-a61d-e23a40cfea30 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:36.599098 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0dc53524-2f86-4a34-a61d-e23a40cfea30 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:36.599536 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0dc53524-2f86-4a34-a61d-e23a40cfea30 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:36.637856 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-0dc53524-2f86-4a34-a61d-e23a40cfea30 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Going to try to terminate instance {{(pid=117742) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:15:36.791335 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-0dc53524-2f86-4a34-a61d-e23a40cfea30 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "DELETE /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 204 len: 0 microversion: 2.1 time: 0.208843 May 27 15:15:36.793029 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 69/116] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:15:36 2022] DELETE /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:15:36.802092 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d6acfb19-00a7-49c2-8806-8a85c7f853a0 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:36.802868 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-d6acfb19-00a7-49c2-8806-8a85c7f853a0 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:36.809106 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d6acfb19-00a7-49c2-8806-8a85c7f853a0 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:36.809560 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d6acfb19-00a7-49c2-8806-8a85c7f853a0 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:36.810698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d6acfb19-00a7-49c2-8806-8a85c7f853a0 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:36.811318 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d6acfb19-00a7-49c2-8806-8a85c7f853a0 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:36.976714 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d6acfb19-00a7-49c2-8806-8a85c7f853a0 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:36.985105 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-d6acfb19-00a7-49c2-8806-8a85c7f853a0 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1553 microversion: 2.1 time: 0.188092 May 27 15:15:36.985671 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 48/117] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:36 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1553 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:38.003727 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-7269be48-84a7-42b7-9938-21e37b467508 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:38.005027 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-7269be48-84a7-42b7-9938-21e37b467508 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:38.015127 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7269be48-84a7-42b7-9938-21e37b467508 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:38.016305 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7269be48-84a7-42b7-9938-21e37b467508 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:38.017435 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7269be48-84a7-42b7-9938-21e37b467508 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:38.018081 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7269be48-84a7-42b7-9938-21e37b467508 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:38.183744 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-7269be48-84a7-42b7-9938-21e37b467508 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:38.192531 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-7269be48-84a7-42b7-9938-21e37b467508 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1553 microversion: 2.1 time: 0.192946 May 27 15:15:38.193114 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 70/118] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:37 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1553 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:39.210117 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-510a0592-b0d1-45c9-a71e-678843a0db3e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:39.210758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-510a0592-b0d1-45c9-a71e-678843a0db3e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:39.217428 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-510a0592-b0d1-45c9-a71e-678843a0db3e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:39.217878 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-510a0592-b0d1-45c9-a71e-678843a0db3e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:39.218945 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-510a0592-b0d1-45c9-a71e-678843a0db3e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:39.219388 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-510a0592-b0d1-45c9-a71e-678843a0db3e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:39.345708 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-510a0592-b0d1-45c9-a71e-678843a0db3e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:39.353758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-510a0592-b0d1-45c9-a71e-678843a0db3e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1553 microversion: 2.1 time: 0.147503 May 27 15:15:39.354324 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 49/119] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:39 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:40.371675 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-056e1638-93b2-4d39-8967-dc9ed21b3aac tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:40.372240 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-056e1638-93b2-4d39-8967-dc9ed21b3aac tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:40.378822 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-056e1638-93b2-4d39-8967-dc9ed21b3aac tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:40.379309 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-056e1638-93b2-4d39-8967-dc9ed21b3aac tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:40.380258 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-056e1638-93b2-4d39-8967-dc9ed21b3aac tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:40.380753 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-056e1638-93b2-4d39-8967-dc9ed21b3aac tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:40.521730 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-056e1638-93b2-4d39-8967-dc9ed21b3aac tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:40.533264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-056e1638-93b2-4d39-8967-dc9ed21b3aac tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1553 microversion: 2.1 time: 0.166184 May 27 15:15:40.533845 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 71/120] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:40 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:41.553435 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9217c58b-6677-4def-bef2-87fc06894999 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:41.554651 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9217c58b-6677-4def-bef2-87fc06894999 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:41.565231 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_api:SELECT=46 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:41.567621 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9217c58b-6677-4def-bef2-87fc06894999 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:41.568910 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9217c58b-6677-4def-bef2-87fc06894999 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:41.570455 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9217c58b-6677-4def-bef2-87fc06894999 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:41.571629 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9217c58b-6677-4def-bef2-87fc06894999 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:41.816827 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9217c58b-6677-4def-bef2-87fc06894999 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:41.825871 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9217c58b-6677-4def-bef2-87fc06894999 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1553 microversion: 2.1 time: 0.276371 May 27 15:15:41.832133 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 50/121] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:41 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1553 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:41.863831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-b6b5d4bd-4f3a-41cc-9ef8-e79f71468442 req-1fd00671-1106-4a43-b160-bf5ce3983685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15b8928d-e849-4c12-b900-e0bfa48a1679", "name": "network-vif-deleted", "tag": "ef128789-5dc1-48ac-aba6-775115b05e14"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:41.867566 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:41.877907 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-b6b5d4bd-4f3a-41cc-9ef8-e79f71468442 req-1fd00671-1106-4a43-b160-bf5ce3983685 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:41.878348 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-b6b5d4bd-4f3a-41cc-9ef8-e79f71468442 req-1fd00671-1106-4a43-b160-bf5ce3983685 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:41.911305 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-b6b5d4bd-4f3a-41cc-9ef8-e79f71468442 req-1fd00671-1106-4a43-b160-bf5ce3983685 service nova] Creating event network-vif-deleted:ef128789-5dc1-48ac-aba6-775115b05e14 for instance 15b8928d-e849-4c12-b900-e0bfa48a1679 on hv-cinder-84254 May 27 15:15:41.921795 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-b6b5d4bd-4f3a-41cc-9ef8-e79f71468442 req-1fd00671-1106-4a43-b160-bf5ce3983685 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062233 May 27 15:15:41.927494 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 72/122] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:42.847993 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-3d2a76c4-cf17-40f3-af05-1e867004a77e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:42.848655 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-3d2a76c4-cf17-40f3-af05-1e867004a77e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:42.856023 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3d2a76c4-cf17-40f3-af05-1e867004a77e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:42.856479 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3d2a76c4-cf17-40f3-af05-1e867004a77e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:42.857259 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3d2a76c4-cf17-40f3-af05-1e867004a77e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:42.857701 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3d2a76c4-cf17-40f3-af05-1e867004a77e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:42.892710 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3d2a76c4-cf17-40f3-af05-1e867004a77e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:42.893395 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3d2a76c4-cf17-40f3-af05-1e867004a77e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:42.894088 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.objects.instance [None req-3d2a76c4-cf17-40f3-af05-1e867004a77e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lazy-loading 'fault' on Instance uuid 15b8928d-e849-4c12-b900-e0bfa48a1679 {{(pid=117743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:15:42.946361 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-3d2a76c4-cf17-40f3-af05-1e867004a77e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92e368db026e4a8f8f4730710471868b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd624b45721514810b49fbbd38c7afb5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:42.955714 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-3d2a76c4-cf17-40f3-af05-1e867004a77e tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 200 len: 1350 microversion: 2.1 time: 0.111480 May 27 15:15:42.956540 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 51/123] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:42 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 1350 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:43.978070 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-539a32e7-b860-497c-b697-754b5ff7ceb6 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:43.979759 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-539a32e7-b860-497c-b697-754b5ff7ceb6 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:43.989008 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-539a32e7-b860-497c-b697-754b5ff7ceb6 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:43.990033 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-539a32e7-b860-497c-b697-754b5ff7ceb6 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:43.991271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-539a32e7-b860-497c-b697-754b5ff7ceb6 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:43.992724 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-539a32e7-b860-497c-b697-754b5ff7ceb6 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:44.047823 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-539a32e7-b860-497c-b697-754b5ff7ceb6 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] HTTP exception thrown: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. May 27 15:15:44.053173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-539a32e7-b860-497c-b697-754b5ff7ceb6 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Request method failure captured: May 27 15:15:44.053173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 HTTP/1.1 May 27 15:15:44.053173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:15:44.053173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:15:44.053173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:15:44.053173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:15:44.053173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:15:44.053173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:15:44.053173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:15:44.053173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:15:44.053173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOrgC9jMClbKJxVQLxgy2oZH7L6wqxBEPxFYp5UwpL4R6r6bA-BE2dbxLXgmBIcL3fBy6UZ3GHEZqAjjWUGxQOm0VsZsnwCB8_Dm9NxqJoS2yaZtAa3lr5F7QbEoMUxPIswYwTrwXcklv2n5B2uysUzNW8wv6q0toxv8bs7P1tzkBEY May 27 15:15:44.053173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:15:44.053173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:15:44.053173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:15:44.053173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:15:44.053173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:15:44.053173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:15:44.053173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: d624b45721514810b49fbbd38c7afb5c May 27 15:15:44.053173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-DeleteServersTestJSON-509085683 May 27 15:15:44.053173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:15:44.053173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:15:44.054708 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d624b45721514810b49fbbd38c7afb5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d624b45721514810b49fbbd38c7afb5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d624b45721514810b49fbbd38c7afb5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d624b45721514810b49fbbd38c7afb5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:15:44.054708 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-DeleteServersTestJSON-509085683 May 27 15:15:44.054708 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: d624b45721514810b49fbbd38c7afb5c May 27 15:15:44.054708 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-DeleteServersTestJSON-509085683 May 27 15:15:44.054708 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-DeleteServersTestJSON-509085683-project May 27 15:15:44.054708 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:15:44.054708 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:15:44.054708 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 92e368db026e4a8f8f4730710471868b May 27 15:15:44.054708 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-DeleteServersTestJSON-509085683-project May 27 15:15:44.054708 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:15:44.054708 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. May 27 15:15:44.054708 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': '15b8928d-e849-4c12-b900-e0bfa48a1679'} May 27 15:15:44.055476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:15:44.055476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:44.055476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:15:44.055476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:15:44.055476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:15:44.055476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:15:44.055476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:15:44.055476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:15:44.055476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:15:44.055476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:15:44.055476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. May 27 15:15:44.055476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:44.055476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:44.055476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:44.055476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:44.055476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:44.055476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:44.055476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:15:44.055476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:15:44.055476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:15:44.056631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:15:44.056631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:15:44.056631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:15:44.056631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:15:44.056631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:15:44.056631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:15:44.056631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:15:44.056631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. May 27 15:15:44.056631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:44.056631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:44.056631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:44.056631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:44.056631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:44.056631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:44.056631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:15:44.056631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:15:44.056631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. May 27 15:15:44.056631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:44.058252 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-539a32e7-b860-497c-b697-754b5ff7ceb6 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Returning 404 to user: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:15:44.059497 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-539a32e7-b860-497c-b697-754b5ff7ceb6 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 404 len: 111 microversion: 2.1 time: 0.084227 May 27 15:15:44.062765 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 73/124] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:43 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:15:44.230839 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-5e94f770-1b9f-4a8e-bb48-a303b2a70e78 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:44.234620 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-5e94f770-1b9f-4a8e-bb48-a303b2a70e78 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:44.243269 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5e94f770-1b9f-4a8e-bb48-a303b2a70e78 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:44.243820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5e94f770-1b9f-4a8e-bb48-a303b2a70e78 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:44.244750 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5e94f770-1b9f-4a8e-bb48-a303b2a70e78 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:44.245264 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5e94f770-1b9f-4a8e-bb48-a303b2a70e78 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:44.259087 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-5e94f770-1b9f-4a8e-bb48-a303b2a70e78 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] HTTP exception thrown: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. May 27 15:15:44.265566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-5e94f770-1b9f-4a8e-bb48-a303b2a70e78 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Request method failure captured: May 27 15:15:44.265566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679/os-volume_attachments HTTP/1.1 May 27 15:15:44.265566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:15:44.265566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:15:44.265566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:15:44.265566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 0 May 27 15:15:44.265566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:15:44.265566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:15:44.265566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:15:44.265566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:15:44.265566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOrgC9jMClbKJxVQLxgy2oZH7L6wqxBEPxFYp5UwpL4R6r6bA-BE2dbxLXgmBIcL3fBy6UZ3GHEZqAjjWUGxQOm0VsZsnwCB8_Dm9NxqJoS2yaZtAa3lr5F7QbEoMUxPIswYwTrwXcklv2n5B2uysUzNW8wv6q0toxv8bs7P1tzkBEY May 27 15:15:44.265566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:15:44.265566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:15:44.265566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:15:44.265566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:15:44.265566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:15:44.265566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:15:44.265566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: d624b45721514810b49fbbd38c7afb5c May 27 15:15:44.265566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-DeleteServersTestJSON-509085683 May 27 15:15:44.265566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:15:44.265566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:15:44.266771 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d624b45721514810b49fbbd38c7afb5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d624b45721514810b49fbbd38c7afb5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d624b45721514810b49fbbd38c7afb5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d624b45721514810b49fbbd38c7afb5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:15:44.266771 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-DeleteServersTestJSON-509085683 May 27 15:15:44.266771 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: d624b45721514810b49fbbd38c7afb5c May 27 15:15:44.266771 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-DeleteServersTestJSON-509085683 May 27 15:15:44.266771 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-DeleteServersTestJSON-509085683-project May 27 15:15:44.266771 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:15:44.266771 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:15:44.266771 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: 92e368db026e4a8f8f4730710471868b May 27 15:15:44.266771 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-DeleteServersTestJSON-509085683-project May 27 15:15:44.266771 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: > May 27 15:15:44.266771 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. May 27 15:15:44.266771 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'server_id': '15b8928d-e849-4c12-b900-e0bfa48a1679'} May 27 15:15:44.267467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:15:44.267467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:44.267467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:15:44.267467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:15:44.267467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:15:44.267467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:15:44.267467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:15:44.267467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:15:44.267467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:15:44.267467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:15:44.267467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. May 27 15:15:44.267467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:44.267467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:44.267467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:44.267467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:44.267467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:44.267467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:44.267467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:15:44.267467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:15:44.267467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:15:44.268700 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:15:44.268700 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 15:15:44.268700 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:15:44.268700 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 15:15:44.268700 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:15:44.268700 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 27 15:15:44.268700 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 27 15:15:44.268700 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:15:44.268700 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:15:44.268700 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. May 27 15:15:44.268700 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:44.268700 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:44.268700 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:44.268700 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:44.268700 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:44.268700 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:44.268700 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:15:44.268700 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:15:44.268700 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. May 27 15:15:44.268700 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:44.269779 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-5e94f770-1b9f-4a8e-bb48-a303b2a70e78 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Returning 404 to user: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:15:44.269779 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-5e94f770-1b9f-4a8e-bb48-a303b2a70e78 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.047659 May 27 15:15:44.269779 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 52/125] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 15:15:44 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:15:45.543798 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-57fd3578-de60-4870-abfd-a28c0606c255 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:45.543798 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-57fd3578-de60-4870-abfd-a28c0606c255 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:45.563600 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-57fd3578-de60-4870-abfd-a28c0606c255 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:45.564235 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-57fd3578-de60-4870-abfd-a28c0606c255 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:45.565630 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-57fd3578-de60-4870-abfd-a28c0606c255 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:45.567616 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-57fd3578-de60-4870-abfd-a28c0606c255 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:45.586547 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-57fd3578-de60-4870-abfd-a28c0606c255 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] HTTP exception thrown: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. May 27 15:15:45.588371 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-57fd3578-de60-4870-abfd-a28c0606c255 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Request method failure captured: May 27 15:15:45.588371 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: DELETE /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 HTTP/1.1 May 27 15:15:45.588371 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:15:45.588371 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:15:45.588371 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:15:45.588371 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:15:45.588371 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:15:45.588371 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:15:45.588371 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:15:45.588371 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:15:45.588371 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOrgC9jMClbKJxVQLxgy2oZH7L6wqxBEPxFYp5UwpL4R6r6bA-BE2dbxLXgmBIcL3fBy6UZ3GHEZqAjjWUGxQOm0VsZsnwCB8_Dm9NxqJoS2yaZtAa3lr5F7QbEoMUxPIswYwTrwXcklv2n5B2uysUzNW8wv6q0toxv8bs7P1tzkBEY May 27 15:15:45.588371 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:15:45.588371 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:15:45.588371 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:15:45.588371 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:15:45.588371 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:15:45.588371 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:15:45.588371 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: d624b45721514810b49fbbd38c7afb5c May 27 15:15:45.588371 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-DeleteServersTestJSON-509085683 May 27 15:15:45.588371 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:15:45.588371 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:15:45.589905 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d624b45721514810b49fbbd38c7afb5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d624b45721514810b49fbbd38c7afb5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d624b45721514810b49fbbd38c7afb5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d624b45721514810b49fbbd38c7afb5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:15:45.589905 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-DeleteServersTestJSON-509085683 May 27 15:15:45.589905 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: d624b45721514810b49fbbd38c7afb5c May 27 15:15:45.589905 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-DeleteServersTestJSON-509085683 May 27 15:15:45.589905 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-DeleteServersTestJSON-509085683-project May 27 15:15:45.589905 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:15:45.589905 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:15:45.589905 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 92e368db026e4a8f8f4730710471868b May 27 15:15:45.589905 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-DeleteServersTestJSON-509085683-project May 27 15:15:45.589905 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:15:45.589905 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. May 27 15:15:45.589905 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': '15b8928d-e849-4c12-b900-e0bfa48a1679'} May 27 15:15:45.590550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:15:45.590550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:45.590550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:15:45.590550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:15:45.590550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:15:45.590550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:15:45.590550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:15:45.590550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:15:45.590550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:15:45.590550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:15:45.590550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. May 27 15:15:45.590550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:45.590550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:45.590550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:45.590550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:45.590550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:45.590550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:45.590550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:15:45.590550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:15:45.590550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:15:45.592231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:15:45.592231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:15:45.592231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:15:45.592231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:15:45.592231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:15:45.592231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:15:45.592231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:15:45.592231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:15:45.592231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:15:45.592231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. May 27 15:15:45.592231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:45.592231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:45.592231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:45.592231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:45.592231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:45.592231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:45.592231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:15:45.592231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:15:45.592231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. May 27 15:15:45.592231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:15:45.595171 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-57fd3578-de60-4870-abfd-a28c0606c255 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Returning 404 to user: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:15:45.595171 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-57fd3578-de60-4870-abfd-a28c0606c255 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "DELETE /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 404 len: 111 microversion: 2.1 time: 0.058937 May 27 15:15:45.595171 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 74/126] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:15:45 2022] DELETE /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:15:45.599210 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-fb347b16-10d0-4167-983e-e0479ea1c2e5 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:45.600060 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-fb347b16-10d0-4167-983e-e0479ea1c2e5 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] [instance: 15b8928d-e849-4c12-b900-e0bfa48a1679] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:45.609471 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fb347b16-10d0-4167-983e-e0479ea1c2e5 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:45.610217 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fb347b16-10d0-4167-983e-e0479ea1c2e5 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:45.610975 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fb347b16-10d0-4167-983e-e0479ea1c2e5 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:45.611331 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fb347b16-10d0-4167-983e-e0479ea1c2e5 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:45.629033 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-fb347b16-10d0-4167-983e-e0479ea1c2e5 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] HTTP exception thrown: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. May 27 15:15:45.631267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-fb347b16-10d0-4167-983e-e0479ea1c2e5 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Request method failure captured: May 27 15:15:45.631267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 HTTP/1.1 May 27 15:15:45.631267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:15:45.631267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:15:45.631267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:15:45.631267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 0 May 27 15:15:45.631267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:15:45.631267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:15:45.631267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:15:45.631267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:15:45.631267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOrgC9jMClbKJxVQLxgy2oZH7L6wqxBEPxFYp5UwpL4R6r6bA-BE2dbxLXgmBIcL3fBy6UZ3GHEZqAjjWUGxQOm0VsZsnwCB8_Dm9NxqJoS2yaZtAa3lr5F7QbEoMUxPIswYwTrwXcklv2n5B2uysUzNW8wv6q0toxv8bs7P1tzkBEY May 27 15:15:45.631267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:15:45.631267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:15:45.631267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:15:45.631267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:15:45.631267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:15:45.631267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:15:45.631267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: d624b45721514810b49fbbd38c7afb5c May 27 15:15:45.631267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-DeleteServersTestJSON-509085683 May 27 15:15:45.631267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:15:45.631267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:15:45.632703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d624b45721514810b49fbbd38c7afb5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d624b45721514810b49fbbd38c7afb5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d624b45721514810b49fbbd38c7afb5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d624b45721514810b49fbbd38c7afb5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:15:45.632703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-DeleteServersTestJSON-509085683 May 27 15:15:45.632703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: d624b45721514810b49fbbd38c7afb5c May 27 15:15:45.632703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-DeleteServersTestJSON-509085683 May 27 15:15:45.632703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-DeleteServersTestJSON-509085683-project May 27 15:15:45.632703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:15:45.632703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:15:45.632703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: 92e368db026e4a8f8f4730710471868b May 27 15:15:45.632703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-DeleteServersTestJSON-509085683-project May 27 15:15:45.632703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: > May 27 15:15:45.632703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. May 27 15:15:45.632703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'id': '15b8928d-e849-4c12-b900-e0bfa48a1679'} May 27 15:15:45.633518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:15:45.633518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:45.633518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:15:45.633518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:15:45.633518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:15:45.633518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:15:45.633518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:15:45.633518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:15:45.633518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:15:45.633518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:15:45.633518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. May 27 15:15:45.633518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:45.633518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:45.633518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:45.633518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:45.633518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:45.633518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:45.633518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:15:45.633518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:15:45.633518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:15:45.634807 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:15:45.634807 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:15:45.634807 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:15:45.634807 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:15:45.634807 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:15:45.634807 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:15:45.634807 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:15:45.634807 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. May 27 15:15:45.634807 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:45.634807 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:15:45.634807 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:45.634807 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:15:45.634807 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:15:45.634807 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:15:45.634807 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:15:45.634807 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:15:45.634807 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. May 27 15:15:45.634807 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:15:45.636074 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-fb347b16-10d0-4167-983e-e0479ea1c2e5 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] Returning 404 to user: Instance 15b8928d-e849-4c12-b900-e0bfa48a1679 could not be found. {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:15:45.636074 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-fb347b16-10d0-4167-983e-e0479ea1c2e5 tempest-DeleteServersTestJSON-509085683 tempest-DeleteServersTestJSON-509085683-project] 10.222.0.50 "GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679" status: 404 len: 111 microversion: 2.1 time: 0.037668 May 27 15:15:45.636788 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 53/127] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:45 2022] GET /compute/v2.1/servers/15b8928d-e849-4c12-b900-e0bfa48a1679 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:15:46.374815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ed66f619-5e15-41fb-b587-49233f4101cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-535833010", "imageRef": "a9407644-1f68-43e6-beb1-ce2085766180", "flavorRef": "452", "networks": [{"uuid": "f8cce512-1e4c-4587-a898-f1e7ebd88680"}]}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:46.546842 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.network.neutron [None req-ed66f619-5e15-41fb-b587-49233f4101cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] validate_networks() for [('f8cce512-1e4c-4587-a898-f1e7ebd88680', None, None, None, None, None)] {{(pid=117742) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:15:47.596194 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-ed66f619-5e15-41fb-b587-49233f4101cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Flavor limits 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:15:47.596749 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-ed66f619-5e15-41fb-b587-49233f4101cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Image limits 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:15:47.597088 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-ed66f619-5e15-41fb-b587-49233f4101cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Flavor pref 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:15:47.597744 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-ed66f619-5e15-41fb-b587-49233f4101cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Image pref 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:15:47.598104 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-ed66f619-5e15-41fb-b587-49233f4101cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:15:47.611194 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ed66f619-5e15-41fb-b587-49233f4101cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:47.611660 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ed66f619-5e15-41fb-b587-49233f4101cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:47.612454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ed66f619-5e15-41fb-b587-49233f4101cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:47.613046 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ed66f619-5e15-41fb-b587-49233f4101cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:47.681327 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-ed66f619-5e15-41fb-b587-49233f4101cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Getting quotas for project a5a48e1060474f21aacf525d26371675. Resources: {'cores', 'ram', 'instances'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:15:47.686603 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-ed66f619-5e15-41fb-b587-49233f4101cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Getting quotas for user 34ac2a8ad2e343838f8e3e3285ec5f55 and project a5a48e1060474f21aacf525d26371675. Resources: {'cores', 'ram', 'instances'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:15:47.704230 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ed66f619-5e15-41fb-b587-49233f4101cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Going to run 1 instances... {{(pid=117742) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:15:47.713956 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ed66f619-5e15-41fb-b587-49233f4101cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9407644-1f68-43e6-beb1-ce2085766180',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117742) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:15:47.837962 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ed66f619-5e15-41fb-b587-49233f4101cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.466362 May 27 15:15:47.840452 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 75/128] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 15:15:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:15:47.849613 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-26049ede-ab3e-4a45-a387-687220cf3e05 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:47.850786 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-26049ede-ab3e-4a45-a387-687220cf3e05 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:48.001129 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-26049ede-ab3e-4a45-a387-687220cf3e05 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:48.021169 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-26049ede-ab3e-4a45-a387-687220cf3e05 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8" status: 200 len: 1213 microversion: 2.1 time: 0.175404 May 27 15:15:48.021761 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 54/129] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:47 2022] GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8 => generated 1213 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:49.044702 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-215a4a9e-c715-4459-b152-248f947037cc tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:49.045313 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-215a4a9e-c715-4459-b152-248f947037cc tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:49.062630 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-215a4a9e-c715-4459-b152-248f947037cc tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:49.063244 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-215a4a9e-c715-4459-b152-248f947037cc tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:49.066826 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-215a4a9e-c715-4459-b152-248f947037cc tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:49.069453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-215a4a9e-c715-4459-b152-248f947037cc tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:49.225078 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-215a4a9e-c715-4459-b152-248f947037cc tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:49.234677 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-215a4a9e-c715-4459-b152-248f947037cc tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8" status: 200 len: 1265 microversion: 2.1 time: 0.196839 May 27 15:15:49.237718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 76/130] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:49 2022] GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:50.255268 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-8f4cdee6-f5d0-4a3b-86c9-96cc4b7b94de tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:50.256021 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-8f4cdee6-f5d0-4a3b-86c9-96cc4b7b94de tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:50.268000 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8f4cdee6-f5d0-4a3b-86c9-96cc4b7b94de tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:50.269889 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8f4cdee6-f5d0-4a3b-86c9-96cc4b7b94de tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:50.270683 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8f4cdee6-f5d0-4a3b-86c9-96cc4b7b94de tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:50.271174 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8f4cdee6-f5d0-4a3b-86c9-96cc4b7b94de tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:50.489056 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-8f4cdee6-f5d0-4a3b-86c9-96cc4b7b94de tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:50.503525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-8f4cdee6-f5d0-4a3b-86c9-96cc4b7b94de tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8" status: 200 len: 1271 microversion: 2.1 time: 0.249596 May 27 15:15:50.506948 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 55/131] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:50 2022] GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8 => generated 1271 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:51.525655 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-bc42bfb8-c1be-464f-a59d-b63845fe656f tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:51.526329 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-bc42bfb8-c1be-464f-a59d-b63845fe656f tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:51.536959 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bc42bfb8-c1be-464f-a59d-b63845fe656f tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:51.537373 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bc42bfb8-c1be-464f-a59d-b63845fe656f tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:51.538143 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bc42bfb8-c1be-464f-a59d-b63845fe656f tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:51.538576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bc42bfb8-c1be-464f-a59d-b63845fe656f tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:52.161277 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-bc42bfb8-c1be-464f-a59d-b63845fe656f tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:52.173237 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-bc42bfb8-c1be-464f-a59d-b63845fe656f tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8" status: 200 len: 1313 microversion: 2.1 time: 0.652141 May 27 15:15:52.174365 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 77/132] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:51 2022] GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8 => generated 1313 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:53.190380 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a8833fe1-3698-4d8c-881b-3553076da49c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:53.191888 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a8833fe1-3698-4d8c-881b-3553076da49c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:53.199899 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a8833fe1-3698-4d8c-881b-3553076da49c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:53.200585 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a8833fe1-3698-4d8c-881b-3553076da49c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:53.201544 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a8833fe1-3698-4d8c-881b-3553076da49c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:53.202357 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a8833fe1-3698-4d8c-881b-3553076da49c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:53.889539 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a8833fe1-3698-4d8c-881b-3553076da49c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:53.903716 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a8833fe1-3698-4d8c-881b-3553076da49c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8" status: 200 len: 1313 microversion: 2.1 time: 0.717932 May 27 15:15:53.913997 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 56/133] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:53 2022] GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8 => generated 1313 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:54.168152 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-84e03a71-b759-408e-b717-104528dae9fd req-40451a7f-72a6-4220-ad6a-9a6744258d6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dabdaa42-448d-4615-a865-527f7fd1b7a8", "tag": "fbd56fb7-c6ee-4d29-835c-f5b0c83adeea"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:54.198553 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-84e03a71-b759-408e-b717-104528dae9fd req-40451a7f-72a6-4220-ad6a-9a6744258d6b service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:54.201512 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-84e03a71-b759-408e-b717-104528dae9fd req-40451a7f-72a6-4220-ad6a-9a6744258d6b service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:54.235293 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-84e03a71-b759-408e-b717-104528dae9fd req-40451a7f-72a6-4220-ad6a-9a6744258d6b service nova] Creating event network-changed:fbd56fb7-c6ee-4d29-835c-f5b0c83adeea for instance dabdaa42-448d-4615-a865-527f7fd1b7a8 on hv-cinder-84254 May 27 15:15:54.255017 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-84e03a71-b759-408e-b717-104528dae9fd req-40451a7f-72a6-4220-ad6a-9a6744258d6b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093930 May 27 15:15:54.256169 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 78/134] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:15:54.923102 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-ba1e2e94-bdcb-43a7-8a07-cebf60a285e4 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:54.924449 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-ba1e2e94-bdcb-43a7-8a07-cebf60a285e4 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:54.935149 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ba1e2e94-bdcb-43a7-8a07-cebf60a285e4 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:54.939761 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ba1e2e94-bdcb-43a7-8a07-cebf60a285e4 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:54.941240 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ba1e2e94-bdcb-43a7-8a07-cebf60a285e4 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:54.947154 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ba1e2e94-bdcb-43a7-8a07-cebf60a285e4 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:55.250961 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-ba1e2e94-bdcb-43a7-8a07-cebf60a285e4 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:55.268097 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-ba1e2e94-bdcb-43a7-8a07-cebf60a285e4 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8" status: 200 len: 1313 microversion: 2.1 time: 0.346516 May 27 15:15:55.281812 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 57/135] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:54 2022] GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8 => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:56.287109 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-33630626-7d17-43b4-9064-75cd57b34acd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:56.287747 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-33630626-7d17-43b4-9064-75cd57b34acd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:56.301633 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-33630626-7d17-43b4-9064-75cd57b34acd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:56.301633 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-33630626-7d17-43b4-9064-75cd57b34acd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:56.305528 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-33630626-7d17-43b4-9064-75cd57b34acd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:56.314972 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-33630626-7d17-43b4-9064-75cd57b34acd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:56.459306 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e63d9fff-59f9-4dec-bb3e-7a2b0c744424 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2131211735", "imageRef": "a9407644-1f68-43e6-beb1-ce2085766180", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:56.536354 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.network.neutron [None req-e63d9fff-59f9-4dec-bb3e-7a2b0c744424 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] validate_networks() for [('0d9b2e84-aea6-4097-b9c0-5d1bab177a20', None, None, None, None, None)] {{(pid=117742) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:15:57.219468 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-33630626-7d17-43b4-9064-75cd57b34acd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:57.226145 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=72 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:57.235256 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-33630626-7d17-43b4-9064-75cd57b34acd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8" status: 200 len: 1313 microversion: 2.1 time: 0.952337 May 27 15:15:57.246669 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 58/136] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:56 2022] GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8 => generated 1313 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:57.672409 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=2 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:57.698491 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=6 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:58.253323 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a05a35d9-19a9-4c0d-af2c-eb315b5c25cd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:58.254117 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a05a35d9-19a9-4c0d-af2c-eb315b5c25cd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:58.271550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=2 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:58.288136 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a05a35d9-19a9-4c0d-af2c-eb315b5c25cd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:58.289899 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a05a35d9-19a9-4c0d-af2c-eb315b5c25cd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:58.291504 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a05a35d9-19a9-4c0d-af2c-eb315b5c25cd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:58.292520 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a05a35d9-19a9-4c0d-af2c-eb315b5c25cd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:58.361752 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-e63d9fff-59f9-4dec-bb3e-7a2b0c744424 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Flavor limits 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:15:58.362521 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-e63d9fff-59f9-4dec-bb3e-7a2b0c744424 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Image limits 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:15:58.363219 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-e63d9fff-59f9-4dec-bb3e-7a2b0c744424 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Flavor pref 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:15:58.363736 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-e63d9fff-59f9-4dec-bb3e-7a2b0c744424 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Image pref 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:15:58.364224 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-e63d9fff-59f9-4dec-bb3e-7a2b0c744424 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:15:58.379164 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e63d9fff-59f9-4dec-bb3e-7a2b0c744424 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:58.382016 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e63d9fff-59f9-4dec-bb3e-7a2b0c744424 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:58.383396 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e63d9fff-59f9-4dec-bb3e-7a2b0c744424 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:15:58.384250 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e63d9fff-59f9-4dec-bb3e-7a2b0c744424 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:15:58.410999 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:15:58.441787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-e63d9fff-59f9-4dec-bb3e-7a2b0c744424 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Getting quotas for project c208c3d86c504ea086bf763e241cbc88. Resources: {'cores', 'ram', 'instances'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:15:58.452240 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-e63d9fff-59f9-4dec-bb3e-7a2b0c744424 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Getting quotas for user 9c9149cb2b3c423796164b487a305bbd and project c208c3d86c504ea086bf763e241cbc88. Resources: {'cores', 'ram', 'instances'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:15:58.483619 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e63d9fff-59f9-4dec-bb3e-7a2b0c744424 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Going to run 1 instances... {{(pid=117742) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:15:58.495157 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e63d9fff-59f9-4dec-bb3e-7a2b0c744424 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9407644-1f68-43e6-beb1-ce2085766180',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117742) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:15:58.562556 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-e63d9fff-59f9-4dec-bb3e-7a2b0c744424 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.330061 May 27 15:15:58.568884 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 79/137] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 15:15:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 2337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:15:58.575051 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-872eccc3-62ff-4e7a-a308-5ba05b532fbb tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:15:58.576040 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-872eccc3-62ff-4e7a-a308-5ba05b532fbb tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:15:58.814101 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-872eccc3-62ff-4e7a-a308-5ba05b532fbb tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:58.829913 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-872eccc3-62ff-4e7a-a308-5ba05b532fbb tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1222 microversion: 2.1 time: 0.259475 May 27 15:15:58.830398 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 80/138] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:58 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1222 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:15:58.982354 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a05a35d9-19a9-4c0d-af2c-eb315b5c25cd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:15:59.001484 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a05a35d9-19a9-4c0d-af2c-eb315b5c25cd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8" status: 200 len: 1313 microversion: 2.1 time: 0.752305 May 27 15:15:59.002765 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 59/139] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:15:58 2022] GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8 => generated 1313 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:15:59.080335 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-a2b38805-5a5a-4c44-962d-471224899dc6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1608552859", "imageRef": "a9407644-1f68-43e6-beb1-ce2085766180", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:15:59.228822 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.network.neutron [None req-a2b38805-5a5a-4c44-962d-471224899dc6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] validate_networks() for [('0d9b2e84-aea6-4097-b9c0-5d1bab177a20', None, None, None, None, None)] {{(pid=117742) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:16:00.019467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-905e52e2-a357-4e4e-83b6-51a21b9288ce tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:00.020396 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-905e52e2-a357-4e4e-83b6-51a21b9288ce tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:00.029482 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-905e52e2-a357-4e4e-83b6-51a21b9288ce tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:00.031389 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-905e52e2-a357-4e4e-83b6-51a21b9288ce tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:00.032364 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-905e52e2-a357-4e4e-83b6-51a21b9288ce tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:00.032815 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-905e52e2-a357-4e4e-83b6-51a21b9288ce tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:00.187315 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-a2b38805-5a5a-4c44-962d-471224899dc6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Flavor limits 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:16:00.188549 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-a2b38805-5a5a-4c44-962d-471224899dc6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Image limits 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:16:00.189208 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-a2b38805-5a5a-4c44-962d-471224899dc6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Flavor pref 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:16:00.190046 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-a2b38805-5a5a-4c44-962d-471224899dc6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Image pref 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:16:00.190656 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-a2b38805-5a5a-4c44-962d-471224899dc6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:16:00.223685 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a2b38805-5a5a-4c44-962d-471224899dc6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:00.224592 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a2b38805-5a5a-4c44-962d-471224899dc6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:00.225755 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a2b38805-5a5a-4c44-962d-471224899dc6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:00.226629 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a2b38805-5a5a-4c44-962d-471224899dc6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:00.277423 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-a2b38805-5a5a-4c44-962d-471224899dc6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Getting quotas for project c208c3d86c504ea086bf763e241cbc88. Resources: {'cores', 'ram', 'instances'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:16:00.289800 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-a2b38805-5a5a-4c44-962d-471224899dc6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Getting quotas for user 9c9149cb2b3c423796164b487a305bbd and project c208c3d86c504ea086bf763e241cbc88. Resources: {'cores', 'ram', 'instances'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:16:00.307233 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-a2b38805-5a5a-4c44-962d-471224899dc6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Going to run 1 instances... {{(pid=117742) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:16:00.309561 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-a2b38805-5a5a-4c44-962d-471224899dc6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9407644-1f68-43e6-beb1-ce2085766180',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117742) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:16:00.389870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-a2b38805-5a5a-4c44-962d-471224899dc6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.318644 May 27 15:16:00.390885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 81/140] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 15:15:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 1320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:16:00.417793 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b52f5b47-949c-4f78-a523-bd530a919dfd tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:00.418664 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b52f5b47-949c-4f78-a523-bd530a919dfd tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:00.513483 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-905e52e2-a357-4e4e-83b6-51a21b9288ce tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:00.534422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-905e52e2-a357-4e4e-83b6-51a21b9288ce tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8" status: 200 len: 1313 microversion: 2.1 time: 0.518133 May 27 15:16:00.536526 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 60/141] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:00 2022] GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8 => generated 1313 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:00.605930 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b52f5b47-949c-4f78-a523-bd530a919dfd tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:00.630696 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b52f5b47-949c-4f78-a523-bd530a919dfd tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1222 microversion: 2.1 time: 0.232604 May 27 15:16:00.633209 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 82/142] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:00 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1222 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:01.552054 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-1f1231a9-8e09-4c60-8b4d-f6da1473bc36 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:01.553324 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-1f1231a9-8e09-4c60-8b4d-f6da1473bc36 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:01.568928 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1f1231a9-8e09-4c60-8b4d-f6da1473bc36 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:01.570460 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1f1231a9-8e09-4c60-8b4d-f6da1473bc36 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:01.575368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1f1231a9-8e09-4c60-8b4d-f6da1473bc36 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:01.577288 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1f1231a9-8e09-4c60-8b4d-f6da1473bc36 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:01.654456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-2bf6d1b8-353d-440f-9475-db0a0ac5fc77 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:01.655939 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-2bf6d1b8-353d-440f-9475-db0a0ac5fc77 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:01.952977 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-1f1231a9-8e09-4c60-8b4d-f6da1473bc36 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:01.965852 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-1f1231a9-8e09-4c60-8b4d-f6da1473bc36 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8" status: 200 len: 1313 microversion: 2.1 time: 0.418709 May 27 15:16:01.973364 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 61/143] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:01 2022] GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8 => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:02.013304 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2bf6d1b8-353d-440f-9475-db0a0ac5fc77 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:02.016044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2bf6d1b8-353d-440f-9475-db0a0ac5fc77 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:02.020267 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2bf6d1b8-353d-440f-9475-db0a0ac5fc77 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:02.022660 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2bf6d1b8-353d-440f-9475-db0a0ac5fc77 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:02.183799 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-2bf6d1b8-353d-440f-9475-db0a0ac5fc77 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:02.201836 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-2bf6d1b8-353d-440f-9475-db0a0ac5fc77 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1218 microversion: 2.1 time: 0.553855 May 27 15:16:02.204681 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 83/144] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:01 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1218 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:02.984360 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-65afaf73-3403-4193-a114-6270061c5e34 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:02.984985 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-65afaf73-3403-4193-a114-6270061c5e34 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:02.997136 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-65afaf73-3403-4193-a114-6270061c5e34 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:02.997407 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-65afaf73-3403-4193-a114-6270061c5e34 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:02.998193 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-65afaf73-3403-4193-a114-6270061c5e34 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:03.000395 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-65afaf73-3403-4193-a114-6270061c5e34 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:03.221946 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-4a8871e0-3c09-4c4d-a05d-fc6b5bb3073a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:03.223842 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-4a8871e0-3c09-4c4d-a05d-fc6b5bb3073a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:03.239538 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4a8871e0-3c09-4c4d-a05d-fc6b5bb3073a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:03.241137 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4a8871e0-3c09-4c4d-a05d-fc6b5bb3073a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:03.242990 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4a8871e0-3c09-4c4d-a05d-fc6b5bb3073a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:03.243591 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4a8871e0-3c09-4c4d-a05d-fc6b5bb3073a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:03.248140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-65afaf73-3403-4193-a114-6270061c5e34 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:03.260912 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-65afaf73-3403-4193-a114-6270061c5e34 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8" status: 200 len: 1313 microversion: 2.1 time: 0.279170 May 27 15:16:03.262876 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 62/145] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:02 2022] GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8 => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:03.385554 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-4a8871e0-3c09-4c4d-a05d-fc6b5bb3073a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:03.397097 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-4a8871e0-3c09-4c4d-a05d-fc6b5bb3073a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1274 microversion: 2.1 time: 0.180693 May 27 15:16:03.401706 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 84/146] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:03 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1274 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:04.283140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-0a84642e-0a52-4c7a-90ed-7ac4a8cf7b2d tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:04.285455 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-0a84642e-0a52-4c7a-90ed-7ac4a8cf7b2d tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:04.295707 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0a84642e-0a52-4c7a-90ed-7ac4a8cf7b2d tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:04.296444 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0a84642e-0a52-4c7a-90ed-7ac4a8cf7b2d tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:04.297911 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0a84642e-0a52-4c7a-90ed-7ac4a8cf7b2d tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:04.298951 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0a84642e-0a52-4c7a-90ed-7ac4a8cf7b2d tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:04.415207 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-cd2b557d-56eb-4d00-b240-dfede1d74fac tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:04.416367 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-cd2b557d-56eb-4d00-b240-dfede1d74fac tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:04.432807 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-cd2b557d-56eb-4d00-b240-dfede1d74fac tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:04.433269 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-cd2b557d-56eb-4d00-b240-dfede1d74fac tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:04.437869 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-cd2b557d-56eb-4d00-b240-dfede1d74fac tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:04.440545 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-cd2b557d-56eb-4d00-b240-dfede1d74fac tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:04.519570 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-0a84642e-0a52-4c7a-90ed-7ac4a8cf7b2d tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:04.536772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-0a84642e-0a52-4c7a-90ed-7ac4a8cf7b2d tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8" status: 200 len: 1313 microversion: 2.1 time: 0.259047 May 27 15:16:04.546939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 63/147] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:04 2022] GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:04.606693 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-cd2b557d-56eb-4d00-b240-dfede1d74fac tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:04.620357 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-cd2b557d-56eb-4d00-b240-dfede1d74fac tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1274 microversion: 2.1 time: 0.203623 May 27 15:16:04.621929 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 85/148] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:04 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1274 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:05.555051 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f4fb55bb-857b-4da8-9b84-aba9c80a40d8 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:05.556917 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-f4fb55bb-857b-4da8-9b84-aba9c80a40d8 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:05.571286 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f4fb55bb-857b-4da8-9b84-aba9c80a40d8 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:05.577323 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f4fb55bb-857b-4da8-9b84-aba9c80a40d8 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:05.578361 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f4fb55bb-857b-4da8-9b84-aba9c80a40d8 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:05.579941 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f4fb55bb-857b-4da8-9b84-aba9c80a40d8 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:05.642749 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-c5f93582-681d-40b6-960b-111ea1545bea tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:05.644184 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-c5f93582-681d-40b6-960b-111ea1545bea tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:05.651333 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c5f93582-681d-40b6-960b-111ea1545bea tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:05.667816 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c5f93582-681d-40b6-960b-111ea1545bea tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:05.671672 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c5f93582-681d-40b6-960b-111ea1545bea tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:05.679742 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c5f93582-681d-40b6-960b-111ea1545bea tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:05.938277 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-c5f93582-681d-40b6-960b-111ea1545bea tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:05.947926 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-c5f93582-681d-40b6-960b-111ea1545bea tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1280 microversion: 2.1 time: 0.312150 May 27 15:16:05.963522 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 86/149] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:05 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1280 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:06.157660 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f4fb55bb-857b-4da8-9b84-aba9c80a40d8 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:06.177617 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-f4fb55bb-857b-4da8-9b84-aba9c80a40d8 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8" status: 200 len: 1313 microversion: 2.1 time: 0.626562 May 27 15:16:06.181782 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 64/150] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:05 2022] GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8 => generated 1313 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:06.982606 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-41d9a03d-854a-4119-89bc-60961bc8afbe tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:06.983487 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-41d9a03d-854a-4119-89bc-60961bc8afbe tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:06.994781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-41d9a03d-854a-4119-89bc-60961bc8afbe tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:06.995343 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-41d9a03d-854a-4119-89bc-60961bc8afbe tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:06.996128 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-41d9a03d-854a-4119-89bc-60961bc8afbe tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:06.996560 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-41d9a03d-854a-4119-89bc-60961bc8afbe tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:07.198087 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-728628b5-b24d-4549-9a66-2acbf7a211e1 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:07.199786 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-728628b5-b24d-4549-9a66-2acbf7a211e1 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:07.215911 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-728628b5-b24d-4549-9a66-2acbf7a211e1 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:07.216363 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-728628b5-b24d-4549-9a66-2acbf7a211e1 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:07.216748 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-41d9a03d-854a-4119-89bc-60961bc8afbe tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:07.218895 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-728628b5-b24d-4549-9a66-2acbf7a211e1 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:07.221613 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-728628b5-b24d-4549-9a66-2acbf7a211e1 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:07.231595 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-41d9a03d-854a-4119-89bc-60961bc8afbe tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1280 microversion: 2.1 time: 0.253474 May 27 15:16:07.239075 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 87/151] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:06 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1280 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:07.539483 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-398185ea-c8a1-45e5-8a0f-93b114506efa req-05a1832c-8613-42ef-b9cb-edefedc0ad4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dabdaa42-448d-4615-a865-527f7fd1b7a8", "name": "network-vif-plugged", "status": "completed", "tag": "fbd56fb7-c6ee-4d29-835c-f5b0c83adeea"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:07.567841 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-398185ea-c8a1-45e5-8a0f-93b114506efa req-05a1832c-8613-42ef-b9cb-edefedc0ad4c service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:07.569140 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-398185ea-c8a1-45e5-8a0f-93b114506efa req-05a1832c-8613-42ef-b9cb-edefedc0ad4c service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:07.596331 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-398185ea-c8a1-45e5-8a0f-93b114506efa req-05a1832c-8613-42ef-b9cb-edefedc0ad4c service nova] Creating event network-vif-plugged:fbd56fb7-c6ee-4d29-835c-f5b0c83adeea for instance dabdaa42-448d-4615-a865-527f7fd1b7a8 on hv-cinder-84254 May 27 15:16:07.605760 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-398185ea-c8a1-45e5-8a0f-93b114506efa req-05a1832c-8613-42ef-b9cb-edefedc0ad4c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072322 May 27 15:16:07.606910 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 88/152] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:07.908555 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-728628b5-b24d-4549-9a66-2acbf7a211e1 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:07.937348 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-728628b5-b24d-4549-9a66-2acbf7a211e1 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8" status: 200 len: 1313 microversion: 2.1 time: 0.743008 May 27 15:16:07.946427 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 65/153] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:07 2022] GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8 => generated 1313 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:08.250587 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ea6ba767-10ed-4dd7-9ce4-ef10ac8fbe89 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:08.251589 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ea6ba767-10ed-4dd7-9ce4-ef10ac8fbe89 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:08.259839 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ea6ba767-10ed-4dd7-9ce4-ef10ac8fbe89 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:08.263851 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ea6ba767-10ed-4dd7-9ce4-ef10ac8fbe89 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:08.264987 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ea6ba767-10ed-4dd7-9ce4-ef10ac8fbe89 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:08.266996 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ea6ba767-10ed-4dd7-9ce4-ef10ac8fbe89 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:08.803520 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-21a79cf0-abf4-419b-ac93-29bd2718985b req-387fc9a6-ee8a-45a0-9f1a-2830bb5c23a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c20afff-0f88-4fdf-9394-7025ab53044a", "tag": "d270ca7e-e0f7-4348-8c7b-947e21204c89"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:08.817277 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-ea6ba767-10ed-4dd7-9ce4-ef10ac8fbe89 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:08.838219 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ea6ba767-10ed-4dd7-9ce4-ef10ac8fbe89 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1322 microversion: 2.1 time: 0.580626 May 27 15:16:08.840935 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 89/154] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:08 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1322 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:08.847720 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-21a79cf0-abf4-419b-ac93-29bd2718985b req-387fc9a6-ee8a-45a0-9f1a-2830bb5c23a2 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:08.848245 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-21a79cf0-abf4-419b-ac93-29bd2718985b req-387fc9a6-ee8a-45a0-9f1a-2830bb5c23a2 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:08.904339 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-21a79cf0-abf4-419b-ac93-29bd2718985b req-387fc9a6-ee8a-45a0-9f1a-2830bb5c23a2 service nova] Creating event network-changed:d270ca7e-e0f7-4348-8c7b-947e21204c89 for instance 5c20afff-0f88-4fdf-9394-7025ab53044a on hv-cinder-84254 May 27 15:16:08.946034 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-21a79cf0-abf4-419b-ac93-29bd2718985b req-387fc9a6-ee8a-45a0-9f1a-2830bb5c23a2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145537 May 27 15:16:08.954278 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-a533c4ce-5fe8-482c-a646-1466c58d4b70 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:08.973938 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-a533c4ce-5fe8-482c-a646-1466c58d4b70 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:08.980378 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 66/155] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:16:08.985223 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a533c4ce-5fe8-482c-a646-1466c58d4b70 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:08.988757 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a533c4ce-5fe8-482c-a646-1466c58d4b70 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:08.989884 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a533c4ce-5fe8-482c-a646-1466c58d4b70 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:08.992265 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a533c4ce-5fe8-482c-a646-1466c58d4b70 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:09.326206 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-3f40cd18-5ac4-4084-977f-170e3ea26950 req-43300e49-e1be-4204-9af6-75a686321706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5efffda6-ae04-4920-bec6-eabacf6739e8", "tag": "8b326e02-fd49-4a67-a328-487945327c6b"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:09.335691 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-3f40cd18-5ac4-4084-977f-170e3ea26950 req-43300e49-e1be-4204-9af6-75a686321706 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:09.336920 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-3f40cd18-5ac4-4084-977f-170e3ea26950 req-43300e49-e1be-4204-9af6-75a686321706 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:09.357249 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-3f40cd18-5ac4-4084-977f-170e3ea26950 req-43300e49-e1be-4204-9af6-75a686321706 service nova] Creating event network-changed:8b326e02-fd49-4a67-a328-487945327c6b for instance 5efffda6-ae04-4920-bec6-eabacf6739e8 on hv-cinder-84254 May 27 15:16:09.365378 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-3f40cd18-5ac4-4084-977f-170e3ea26950 req-43300e49-e1be-4204-9af6-75a686321706 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044091 May 27 15:16:09.366408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 67/156] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:09.441122 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-a533c4ce-5fe8-482c-a646-1466c58d4b70 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:09.451123 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-a533c4ce-5fe8-482c-a646-1466c58d4b70 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8" status: 200 len: 1313 microversion: 2.1 time: 0.500564 May 27 15:16:09.460806 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 90/157] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:08 2022] GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8 => generated 1313 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:09.864556 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-2b40cbed-e636-442d-909e-915e570a52f7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:09.867590 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-2b40cbed-e636-442d-909e-915e570a52f7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:09.895481 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2b40cbed-e636-442d-909e-915e570a52f7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:09.896079 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2b40cbed-e636-442d-909e-915e570a52f7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:09.901569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2b40cbed-e636-442d-909e-915e570a52f7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:09.904399 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2b40cbed-e636-442d-909e-915e570a52f7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:10.332834 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-2b40cbed-e636-442d-909e-915e570a52f7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:10.352166 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-2b40cbed-e636-442d-909e-915e570a52f7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1322 microversion: 2.1 time: 0.497024 May 27 15:16:10.353783 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 68/158] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:09 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1322 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:10.468845 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-66c10cc3-93cd-4cc4-b39c-cb577eb5acef tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:10.470367 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-66c10cc3-93cd-4cc4-b39c-cb577eb5acef tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:10.477589 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=4 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:10.483104 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-66c10cc3-93cd-4cc4-b39c-cb577eb5acef tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:10.484090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-66c10cc3-93cd-4cc4-b39c-cb577eb5acef tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:10.486429 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-66c10cc3-93cd-4cc4-b39c-cb577eb5acef tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:10.488696 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-66c10cc3-93cd-4cc4-b39c-cb577eb5acef tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:10.625092 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=16 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:10.910873 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-66c10cc3-93cd-4cc4-b39c-cb577eb5acef tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:10.926445 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-66c10cc3-93cd-4cc4-b39c-cb577eb5acef tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8" status: 200 len: 1496 microversion: 2.1 time: 0.456069 May 27 15:16:10.931330 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 91/159] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:10 2022] GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8 => generated 1496 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:11.378990 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a142bbf7-4e2e-4b36-b26e-f74b279e1b5a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:11.380456 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a142bbf7-4e2e-4b36-b26e-f74b279e1b5a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:11.390440 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a142bbf7-4e2e-4b36-b26e-f74b279e1b5a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:11.392145 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a142bbf7-4e2e-4b36-b26e-f74b279e1b5a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:11.394976 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a142bbf7-4e2e-4b36-b26e-f74b279e1b5a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:11.396017 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a142bbf7-4e2e-4b36-b26e-f74b279e1b5a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:12.146268 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-21c3af50-e953-49ce-a59e-35ad10865448 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:12.147363 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-21c3af50-e953-49ce-a59e-35ad10865448 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:12.156265 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-21c3af50-e953-49ce-a59e-35ad10865448 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:12.156981 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-21c3af50-e953-49ce-a59e-35ad10865448 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:12.158058 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-21c3af50-e953-49ce-a59e-35ad10865448 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:12.159233 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-21c3af50-e953-49ce-a59e-35ad10865448 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:12.249876 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-21c3af50-e953-49ce-a59e-35ad10865448 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] Going to try to terminate instance {{(pid=117742) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:16:12.302141 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a142bbf7-4e2e-4b36-b26e-f74b279e1b5a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:12.313343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a142bbf7-4e2e-4b36-b26e-f74b279e1b5a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1322 microversion: 2.1 time: 0.943865 May 27 15:16:12.319100 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 69/160] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:11 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1322 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:12.441814 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-21c3af50-e953-49ce-a59e-35ad10865448 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8" status: 204 len: 0 microversion: 2.1 time: 0.299258 May 27 15:16:12.442479 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 92/161] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:16:12 2022] DELETE /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:16:12.453578 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-ce9bbf0d-d715-4976-a9e6-e48050e3eb65 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:12.454234 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-ce9bbf0d-d715-4976-a9e6-e48050e3eb65 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:12.458586 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_api:SELECT=44 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:12.466457 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ce9bbf0d-d715-4976-a9e6-e48050e3eb65 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:12.467331 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ce9bbf0d-d715-4976-a9e6-e48050e3eb65 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:12.468809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ce9bbf0d-d715-4976-a9e6-e48050e3eb65 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:12.469448 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ce9bbf0d-d715-4976-a9e6-e48050e3eb65 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:12.752226 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-ce9bbf0d-d715-4976-a9e6-e48050e3eb65 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:12.765976 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-ce9bbf0d-d715-4976-a9e6-e48050e3eb65 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8" status: 200 len: 1502 microversion: 2.1 time: 0.318445 May 27 15:16:12.769625 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 70/162] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:12 2022] GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8 => generated 1502 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:13.350362 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-58bb1319-894a-4a93-b8d9-6f5f21c7499a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:13.351396 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-58bb1319-894a-4a93-b8d9-6f5f21c7499a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:13.366942 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-58bb1319-894a-4a93-b8d9-6f5f21c7499a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:13.369265 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-58bb1319-894a-4a93-b8d9-6f5f21c7499a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:13.370140 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-58bb1319-894a-4a93-b8d9-6f5f21c7499a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:13.370573 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-58bb1319-894a-4a93-b8d9-6f5f21c7499a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:13.653162 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-58bb1319-894a-4a93-b8d9-6f5f21c7499a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:13.677343 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-58bb1319-894a-4a93-b8d9-6f5f21c7499a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1322 microversion: 2.1 time: 0.338055 May 27 15:16:13.683315 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 93/163] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:13 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:13.783088 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-32ebdb56-e466-492c-84a9-64cea263a1d7 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:13.783704 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-32ebdb56-e466-492c-84a9-64cea263a1d7 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:13.791209 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-32ebdb56-e466-492c-84a9-64cea263a1d7 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:13.791688 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-32ebdb56-e466-492c-84a9-64cea263a1d7 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:13.792490 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-32ebdb56-e466-492c-84a9-64cea263a1d7 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:13.792939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-32ebdb56-e466-492c-84a9-64cea263a1d7 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:14.153117 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-32ebdb56-e466-492c-84a9-64cea263a1d7 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:14.164696 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-32ebdb56-e466-492c-84a9-64cea263a1d7 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8" status: 200 len: 1502 microversion: 2.1 time: 0.384022 May 27 15:16:14.168110 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 71/164] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:13 2022] GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8 => generated 1502 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:14.702528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-7ef32c2a-e981-478e-be4e-a51b56b00d3c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:14.703241 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-7ef32c2a-e981-478e-be4e-a51b56b00d3c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:14.706333 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:14.718562 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7ef32c2a-e981-478e-be4e-a51b56b00d3c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:14.719053 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7ef32c2a-e981-478e-be4e-a51b56b00d3c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:14.719837 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7ef32c2a-e981-478e-be4e-a51b56b00d3c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:14.723907 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7ef32c2a-e981-478e-be4e-a51b56b00d3c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:14.931238 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-7ef32c2a-e981-478e-be4e-a51b56b00d3c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:14.944222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-7ef32c2a-e981-478e-be4e-a51b56b00d3c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1322 microversion: 2.1 time: 0.247020 May 27 15:16:14.945164 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 94/165] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:14 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:15.213408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-e31a3fe1-dee6-48c5-9017-00e89ef7728a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:15.213924 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-e31a3fe1-dee6-48c5-9017-00e89ef7728a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:15.241997 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e31a3fe1-dee6-48c5-9017-00e89ef7728a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:15.242452 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e31a3fe1-dee6-48c5-9017-00e89ef7728a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:15.243838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e31a3fe1-dee6-48c5-9017-00e89ef7728a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:15.244368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e31a3fe1-dee6-48c5-9017-00e89ef7728a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:15.444662 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-e31a3fe1-dee6-48c5-9017-00e89ef7728a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:15.453269 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-e31a3fe1-dee6-48c5-9017-00e89ef7728a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8" status: 200 len: 1502 microversion: 2.1 time: 0.273383 May 27 15:16:15.453857 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 72/166] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:15 2022] GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8 => generated 1502 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:15.961547 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-89d5be34-c3a4-4e2b-96bd-a7d901c5ee45 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:15.962922 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-89d5be34-c3a4-4e2b-96bd-a7d901c5ee45 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:15.972392 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-89d5be34-c3a4-4e2b-96bd-a7d901c5ee45 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:15.977312 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-89d5be34-c3a4-4e2b-96bd-a7d901c5ee45 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:15.978947 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-89d5be34-c3a4-4e2b-96bd-a7d901c5ee45 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:15.982418 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-89d5be34-c3a4-4e2b-96bd-a7d901c5ee45 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:16.232817 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-89d5be34-c3a4-4e2b-96bd-a7d901c5ee45 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:16.241793 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-89d5be34-c3a4-4e2b-96bd-a7d901c5ee45 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1322 microversion: 2.1 time: 0.283997 May 27 15:16:16.243778 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 95/167] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:15 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:16.470606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-addfd93b-ca39-47fc-b76a-ef3ad8aaaf67 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:16.471934 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-addfd93b-ca39-47fc-b76a-ef3ad8aaaf67 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:16.487307 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-addfd93b-ca39-47fc-b76a-ef3ad8aaaf67 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:16.487769 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-addfd93b-ca39-47fc-b76a-ef3ad8aaaf67 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:16.488563 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-addfd93b-ca39-47fc-b76a-ef3ad8aaaf67 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:16.489001 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-addfd93b-ca39-47fc-b76a-ef3ad8aaaf67 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:16.909024 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-57b5e7b4-3439-44e9-bdad-9c8e3e63ad12 req-6d0e7dad-4ad6-4c1f-abe2-ec0a0b07d573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dabdaa42-448d-4615-a865-527f7fd1b7a8", "name": "network-vif-deleted", "tag": "fbd56fb7-c6ee-4d29-835c-f5b0c83adeea"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:16.947522 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-57b5e7b4-3439-44e9-bdad-9c8e3e63ad12 req-6d0e7dad-4ad6-4c1f-abe2-ec0a0b07d573 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:16.948498 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-57b5e7b4-3439-44e9-bdad-9c8e3e63ad12 req-6d0e7dad-4ad6-4c1f-abe2-ec0a0b07d573 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:16.969112 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-addfd93b-ca39-47fc-b76a-ef3ad8aaaf67 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:16.975639 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-57b5e7b4-3439-44e9-bdad-9c8e3e63ad12 req-6d0e7dad-4ad6-4c1f-abe2-ec0a0b07d573 service nova] Creating event network-vif-deleted:fbd56fb7-c6ee-4d29-835c-f5b0c83adeea for instance dabdaa42-448d-4615-a865-527f7fd1b7a8 on hv-cinder-84254 May 27 15:16:16.980382 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-addfd93b-ca39-47fc-b76a-ef3ad8aaaf67 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8" status: 200 len: 1502 microversion: 2.1 time: 0.513769 May 27 15:16:16.989463 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 73/168] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:16 2022] GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8 => generated 1502 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:17.006812 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-57b5e7b4-3439-44e9-bdad-9c8e3e63ad12 req-6d0e7dad-4ad6-4c1f-abe2-ec0a0b07d573 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109215 May 27 15:16:17.016663 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 96/169] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:17.260986 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-c6e45dcc-d1a5-484a-a97a-fcea28fc0688 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:17.262502 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-c6e45dcc-d1a5-484a-a97a-fcea28fc0688 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:17.273300 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c6e45dcc-d1a5-484a-a97a-fcea28fc0688 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:17.278257 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c6e45dcc-d1a5-484a-a97a-fcea28fc0688 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:17.287741 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c6e45dcc-d1a5-484a-a97a-fcea28fc0688 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:17.292403 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c6e45dcc-d1a5-484a-a97a-fcea28fc0688 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:17.569478 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-c6e45dcc-d1a5-484a-a97a-fcea28fc0688 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:17.597329 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-c6e45dcc-d1a5-484a-a97a-fcea28fc0688 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1322 microversion: 2.1 time: 0.339772 May 27 15:16:17.600367 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 74/170] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:17 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:18.005786 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ea06ce2f-34ab-4ffb-8cdc-10badac10f88 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:18.006500 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ea06ce2f-34ab-4ffb-8cdc-10badac10f88 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: dabdaa42-448d-4615-a865-527f7fd1b7a8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:18.023040 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ea06ce2f-34ab-4ffb-8cdc-10badac10f88 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:18.023556 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ea06ce2f-34ab-4ffb-8cdc-10badac10f88 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:18.025120 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ea06ce2f-34ab-4ffb-8cdc-10badac10f88 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:18.028862 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ea06ce2f-34ab-4ffb-8cdc-10badac10f88 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:18.061090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-ea06ce2f-34ab-4ffb-8cdc-10badac10f88 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] HTTP exception thrown: Instance dabdaa42-448d-4615-a865-527f7fd1b7a8 could not be found. May 27 15:16:18.069034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ea06ce2f-34ab-4ffb-8cdc-10badac10f88 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Request method failure captured: May 27 15:16:18.069034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8 HTTP/1.1 May 27 15:16:18.069034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:16:18.069034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:16:18.069034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:16:18.069034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:16:18.069034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:16:18.069034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:16:18.069034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:16:18.069034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:16:18.069034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOsg4ExFMn1KJDNFrOcp86dq2tqwWT7Mg2EmKTpkN7GCSsu8nQgukkJnngLJuqupt_k0-gX-z2Zs9jphf6kHKXR9w4WD4vuuYa3A6dn9YVvyhOzeqUlkkfN2_8JxewxDhe-kUi0axX5_96ruxz7hob1U5MiJxrGoSqIudXlXJY38Z44 May 27 15:16:18.069034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:16:18.069034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:16:18.069034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:16:18.069034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:16:18.069034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:16:18.069034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:16:18.069034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: a5a48e1060474f21aacf525d26371675 May 27 15:16:18.069034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-VolumesActionsTest-1104142404 May 27 15:16:18.069034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:16:18.069034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:16:18.071254 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a5a48e1060474f21aacf525d26371675"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a5a48e1060474f21aacf525d26371675"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a5a48e1060474f21aacf525d26371675"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a5a48e1060474f21aacf525d26371675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:16:18.071254 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-VolumesActionsTest-1104142404 May 27 15:16:18.071254 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: a5a48e1060474f21aacf525d26371675 May 27 15:16:18.071254 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-VolumesActionsTest-1104142404 May 27 15:16:18.071254 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-VolumesActionsTest-1104142404-project May 27 15:16:18.071254 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:16:18.071254 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:16:18.071254 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 34ac2a8ad2e343838f8e3e3285ec5f55 May 27 15:16:18.071254 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-VolumesActionsTest-1104142404-project May 27 15:16:18.071254 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:16:18.071254 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance dabdaa42-448d-4615-a865-527f7fd1b7a8 could not be found. May 27 15:16:18.071254 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': 'dabdaa42-448d-4615-a865-527f7fd1b7a8'} May 27 15:16:18.075482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:16:18.075482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:18.075482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:16:18.075482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:16:18.075482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:16:18.075482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:16:18.075482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:16:18.075482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:16:18.075482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:16:18.075482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:16:18.075482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dabdaa42-448d-4615-a865-527f7fd1b7a8 could not be found. May 27 15:16:18.075482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:16:18.075482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:18.075482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:16:18.075482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:18.075482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:18.075482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:18.075482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:16:18.075482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:16:18.075482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:16:18.077692 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:16:18.077692 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:16:18.077692 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:16:18.077692 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:16:18.077692 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:16:18.077692 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:16:18.077692 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:16:18.077692 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dabdaa42-448d-4615-a865-527f7fd1b7a8 could not be found. May 27 15:16:18.077692 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:16:18.077692 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:16:18.077692 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:16:18.077692 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:16:18.077692 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:16:18.077692 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:16:18.077692 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:16:18.077692 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:16:18.077692 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dabdaa42-448d-4615-a865-527f7fd1b7a8 could not be found. May 27 15:16:18.077692 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:16:18.083274 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ea06ce2f-34ab-4ffb-8cdc-10badac10f88 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Returning 404 to user: Instance dabdaa42-448d-4615-a865-527f7fd1b7a8 could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:16:18.083274 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ea06ce2f-34ab-4ffb-8cdc-10badac10f88 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8" status: 404 len: 111 microversion: 2.1 time: 0.070314 May 27 15:16:18.086445 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 97/171] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:17 2022] GET /compute/v2.1/servers/dabdaa42-448d-4615-a865-527f7fd1b7a8 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:16:18.295824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9711d7f9-0989-41ff-8aaf-d34b1572544a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-427476987", "imageRef": "a9407644-1f68-43e6-beb1-ce2085766180", "flavorRef": "452", "networks": [{"uuid": "f8cce512-1e4c-4587-a898-f1e7ebd88680"}]}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:18.419347 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-7001b6d8-46e1-4eb9-87e3-2a7e8885d787 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:18.420047 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-7001b6d8-46e1-4eb9-87e3-2a7e8885d787 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:18.436001 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7001b6d8-46e1-4eb9-87e3-2a7e8885d787 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:18.438298 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7001b6d8-46e1-4eb9-87e3-2a7e8885d787 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:18.440073 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7001b6d8-46e1-4eb9-87e3-2a7e8885d787 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:18.446252 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.network.neutron [None req-9711d7f9-0989-41ff-8aaf-d34b1572544a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] validate_networks() for [('f8cce512-1e4c-4587-a898-f1e7ebd88680', None, None, None, None, None)] {{(pid=117743) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:16:18.456450 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7001b6d8-46e1-4eb9-87e3-2a7e8885d787 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:18.526160 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-7001b6d8-46e1-4eb9-87e3-2a7e8885d787 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27/ips" status: 200 len: 145 microversion: 2.1 time: 0.109903 May 27 15:16:18.535268 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 98/172] 10.222.0.50 () {58 vars in 1247 bytes} [Fri May 27 15:16:18 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27/ips => generated 145 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:16:18.617996 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-3e0f4130-a5a1-46b5-a7d9-4d51e3958a32 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:18.618802 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-3e0f4130-a5a1-46b5-a7d9-4d51e3958a32 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:18.636388 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3e0f4130-a5a1-46b5-a7d9-4d51e3958a32 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:18.638255 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3e0f4130-a5a1-46b5-a7d9-4d51e3958a32 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:18.644276 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3e0f4130-a5a1-46b5-a7d9-4d51e3958a32 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:18.655718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3e0f4130-a5a1-46b5-a7d9-4d51e3958a32 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:19.097659 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-3e0f4130-a5a1-46b5-a7d9-4d51e3958a32 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:19.100780 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:19.116914 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-3e0f4130-a5a1-46b5-a7d9-4d51e3958a32 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1322 microversion: 2.1 time: 0.504297 May 27 15:16:19.122880 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 99/173] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:18 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1322 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:20.011579 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-9711d7f9-0989-41ff-8aaf-d34b1572544a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Flavor limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:16:20.012901 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-9711d7f9-0989-41ff-8aaf-d34b1572544a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Image limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:16:20.013525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-9711d7f9-0989-41ff-8aaf-d34b1572544a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Flavor pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:16:20.014466 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-9711d7f9-0989-41ff-8aaf-d34b1572544a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Image pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:16:20.016020 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-9711d7f9-0989-41ff-8aaf-d34b1572544a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:16:20.033714 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9711d7f9-0989-41ff-8aaf-d34b1572544a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:20.035750 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9711d7f9-0989-41ff-8aaf-d34b1572544a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:20.038588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9711d7f9-0989-41ff-8aaf-d34b1572544a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:20.040621 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9711d7f9-0989-41ff-8aaf-d34b1572544a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:20.105233 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-9711d7f9-0989-41ff-8aaf-d34b1572544a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Getting quotas for project a5a48e1060474f21aacf525d26371675. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:16:20.117326 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-9711d7f9-0989-41ff-8aaf-d34b1572544a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Getting quotas for user 34ac2a8ad2e343838f8e3e3285ec5f55 and project a5a48e1060474f21aacf525d26371675. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:16:20.141740 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ec7a15c3-f82b-4f64-bd3c-1fda944c3e69 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:20.142976 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ec7a15c3-f82b-4f64-bd3c-1fda944c3e69 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:20.147392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9711d7f9-0989-41ff-8aaf-d34b1572544a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Going to run 1 instances... {{(pid=117743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:16:20.151365 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9711d7f9-0989-41ff-8aaf-d34b1572544a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9407644-1f68-43e6-beb1-ce2085766180',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:16:20.159200 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ec7a15c3-f82b-4f64-bd3c-1fda944c3e69 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:20.159651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ec7a15c3-f82b-4f64-bd3c-1fda944c3e69 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:20.169376 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ec7a15c3-f82b-4f64-bd3c-1fda944c3e69 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:20.171132 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ec7a15c3-f82b-4f64-bd3c-1fda944c3e69 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:20.304538 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9711d7f9-0989-41ff-8aaf-d34b1572544a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.012729 May 27 15:16:20.311295 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 75/174] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 15:16:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:16:20.324232 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-3ca5af60-cdb4-45d0-a5e9-80cd9c2a6e39 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:20.325462 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-3ca5af60-cdb4-45d0-a5e9-80cd9c2a6e39 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:20.563703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-3ca5af60-cdb4-45d0-a5e9-80cd9c2a6e39 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:20.573859 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-3ca5af60-cdb4-45d0-a5e9-80cd9c2a6e39 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1213 microversion: 2.1 time: 0.259459 May 27 15:16:20.577605 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 76/175] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:20 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1213 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:20.914643 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-ec7a15c3-f82b-4f64-bd3c-1fda944c3e69 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:20.929289 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ec7a15c3-f82b-4f64-bd3c-1fda944c3e69 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1322 microversion: 2.1 time: 0.790931 May 27 15:16:20.933696 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 100/176] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:20 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1322 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:21.594626 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-684d60ba-1e00-40de-8c87-f9e807fe8118 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:21.595891 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-684d60ba-1e00-40de-8c87-f9e807fe8118 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:21.612878 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-684d60ba-1e00-40de-8c87-f9e807fe8118 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:21.619227 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-684d60ba-1e00-40de-8c87-f9e807fe8118 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:21.622072 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-684d60ba-1e00-40de-8c87-f9e807fe8118 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:21.622428 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-684d60ba-1e00-40de-8c87-f9e807fe8118 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:21.953484 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ec88c0ac-ef26-468b-ad11-613d77f66cc9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:21.955033 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ec88c0ac-ef26-468b-ad11-613d77f66cc9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:21.969778 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ec88c0ac-ef26-468b-ad11-613d77f66cc9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:21.973051 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ec88c0ac-ef26-468b-ad11-613d77f66cc9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:21.974110 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ec88c0ac-ef26-468b-ad11-613d77f66cc9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:21.978096 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ec88c0ac-ef26-468b-ad11-613d77f66cc9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:22.038021 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-684d60ba-1e00-40de-8c87-f9e807fe8118 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:22.046476 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-684d60ba-1e00-40de-8c87-f9e807fe8118 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1209 microversion: 2.1 time: 0.456159 May 27 15:16:22.052777 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 77/177] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:21 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1209 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:22.221529 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-fb41f59e-7651-4c5c-9b9d-165e0c49eb3e req-33627ca3-20cc-4dee-9de2-43af7f8e00cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c20afff-0f88-4fdf-9394-7025ab53044a", "name": "network-vif-plugged", "status": "completed", "tag": "d270ca7e-e0f7-4348-8c7b-947e21204c89"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:22.240592 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-fb41f59e-7651-4c5c-9b9d-165e0c49eb3e req-33627ca3-20cc-4dee-9de2-43af7f8e00cc service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:22.245750 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-fb41f59e-7651-4c5c-9b9d-165e0c49eb3e req-33627ca3-20cc-4dee-9de2-43af7f8e00cc service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:22.267590 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-fb41f59e-7651-4c5c-9b9d-165e0c49eb3e req-33627ca3-20cc-4dee-9de2-43af7f8e00cc service nova] Creating event network-vif-plugged:d270ca7e-e0f7-4348-8c7b-947e21204c89 for instance 5c20afff-0f88-4fdf-9394-7025ab53044a on hv-cinder-84254 May 27 15:16:22.274722 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-fb41f59e-7651-4c5c-9b9d-165e0c49eb3e req-33627ca3-20cc-4dee-9de2-43af7f8e00cc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057447 May 27 15:16:22.276071 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 78/178] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:16:22.401844 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-0139706a-cfc2-4638-b6d8-0e7f6ae532f3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "267077e5-d95e-433d-807c-18d37debb8be"}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:22.403027 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-0139706a-cfc2-4638-b6d8-0e7f6ae532f3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:22.477389 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0139706a-cfc2-4638-b6d8-0e7f6ae532f3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:22.478682 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0139706a-cfc2-4638-b6d8-0e7f6ae532f3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:22.483203 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0139706a-cfc2-4638-b6d8-0e7f6ae532f3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:22.486059 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0139706a-cfc2-4638-b6d8-0e7f6ae532f3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:22.499481 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=100 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:23.005012 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-ec88c0ac-ef26-468b-ad11-613d77f66cc9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:23.021101 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ec88c0ac-ef26-468b-ad11-613d77f66cc9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1322 microversion: 2.1 time: 1.071655 May 27 15:16:23.021694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 101/179] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:21 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1322 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:23.070142 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f4cda19f-5c2d-44bf-995c-fa17cd8b227b tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:23.072198 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f4cda19f-5c2d-44bf-995c-fa17cd8b227b tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:23.106076 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f4cda19f-5c2d-44bf-995c-fa17cd8b227b tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:23.114689 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f4cda19f-5c2d-44bf-995c-fa17cd8b227b tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:23.121608 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f4cda19f-5c2d-44bf-995c-fa17cd8b227b tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:23.125573 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f4cda19f-5c2d-44bf-995c-fa17cd8b227b tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:23.535564 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f4cda19f-5c2d-44bf-995c-fa17cd8b227b tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:23.551407 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f4cda19f-5c2d-44bf-995c-fa17cd8b227b tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1271 microversion: 2.1 time: 0.482662 May 27 15:16:23.566638 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 102/180] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:23 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1271 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:23.734282 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-0139706a-cfc2-4638-b6d8-0e7f6ae532f3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "POST /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.337002 May 27 15:16:23.744188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 79/181] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 15:16:22 2022] POST /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27/os-volume_attachments => generated 194 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:24.040954 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-cce7b73b-7d87-4069-999c-be5b5182de9b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:24.042320 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-cce7b73b-7d87-4069-999c-be5b5182de9b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:24.054053 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-cce7b73b-7d87-4069-999c-be5b5182de9b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:24.055314 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-cce7b73b-7d87-4069-999c-be5b5182de9b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:24.056655 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-cce7b73b-7d87-4069-999c-be5b5182de9b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:24.059808 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-cce7b73b-7d87-4069-999c-be5b5182de9b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:24.333034 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-4a782d79-1099-4793-91a2-fd3a9ef19f92 req-c8219869-fff3-44b3-a098-0f478e7bd733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5efffda6-ae04-4920-bec6-eabacf6739e8", "name": "network-vif-plugged", "status": "completed", "tag": "8b326e02-fd49-4a67-a328-487945327c6b"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:24.393289 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-4a782d79-1099-4793-91a2-fd3a9ef19f92 req-c8219869-fff3-44b3-a098-0f478e7bd733 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:24.395957 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-4a782d79-1099-4793-91a2-fd3a9ef19f92 req-c8219869-fff3-44b3-a098-0f478e7bd733 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:24.503002 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-4a782d79-1099-4793-91a2-fd3a9ef19f92 req-c8219869-fff3-44b3-a098-0f478e7bd733 service nova] Creating event network-vif-plugged:8b326e02-fd49-4a67-a328-487945327c6b for instance 5efffda6-ae04-4920-bec6-eabacf6739e8 on hv-cinder-84254 May 27 15:16:24.517419 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-4a782d79-1099-4793-91a2-fd3a9ef19f92 req-c8219869-fff3-44b3-a098-0f478e7bd733 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188394 May 27 15:16:24.523849 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 80/182] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:16:24.530260 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-cce7b73b-7d87-4069-999c-be5b5182de9b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:24.539941 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-cce7b73b-7d87-4069-999c-be5b5182de9b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1322 microversion: 2.1 time: 0.503873 May 27 15:16:24.543230 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 103/183] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:24 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1322 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:24.577626 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-473c15ff-930d-4f3d-b4db-32629d5147b4 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:24.578917 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-473c15ff-930d-4f3d-b4db-32629d5147b4 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:24.595403 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-473c15ff-930d-4f3d-b4db-32629d5147b4 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:24.601637 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-473c15ff-930d-4f3d-b4db-32629d5147b4 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:24.615987 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-473c15ff-930d-4f3d-b4db-32629d5147b4 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:24.618280 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-473c15ff-930d-4f3d-b4db-32629d5147b4 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:24.892949 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-18ccd6d9-996e-43d4-902f-1c45b7292381 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:24.893909 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-18ccd6d9-996e-43d4-902f-1c45b7292381 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:24.914177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-18ccd6d9-996e-43d4-902f-1c45b7292381 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:24.918044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-18ccd6d9-996e-43d4-902f-1c45b7292381 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:24.919576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-18ccd6d9-996e-43d4-902f-1c45b7292381 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:24.920396 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-18ccd6d9-996e-43d4-902f-1c45b7292381 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:24.969489 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-473c15ff-930d-4f3d-b4db-32629d5147b4 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:24.988268 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-18ccd6d9-996e-43d4-902f-1c45b7292381 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed/ips" status: 200 len: 150 microversion: 2.20 time: 0.107912 May 27 15:16:24.989588 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 104/184] 10.222.0.50 () {60 vars in 1288 bytes} [Fri May 27 15:16:24 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed/ips => generated 150 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:16:25.001255 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-473c15ff-930d-4f3d-b4db-32629d5147b4 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1271 microversion: 2.1 time: 0.418565 May 27 15:16:25.004702 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 81/185] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:24 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1271 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:25.561402 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b139100e-e178-4324-9452-4c8fdeb4f071 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:25.562011 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b139100e-e178-4324-9452-4c8fdeb4f071 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:25.588062 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b139100e-e178-4324-9452-4c8fdeb4f071 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:25.588512 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b139100e-e178-4324-9452-4c8fdeb4f071 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:25.589308 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b139100e-e178-4324-9452-4c8fdeb4f071 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:25.589754 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b139100e-e178-4324-9452-4c8fdeb4f071 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:26.027009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-5d737b24-1be9-4727-a796-e29b22987d8e tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:26.031691 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-5d737b24-1be9-4727-a796-e29b22987d8e tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:26.064815 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5d737b24-1be9-4727-a796-e29b22987d8e tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:26.065661 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5d737b24-1be9-4727-a796-e29b22987d8e tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:26.068211 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5d737b24-1be9-4727-a796-e29b22987d8e tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:26.072879 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5d737b24-1be9-4727-a796-e29b22987d8e tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:26.222395 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b139100e-e178-4324-9452-4c8fdeb4f071 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:26.239081 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b139100e-e178-4324-9452-4c8fdeb4f071 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1322 microversion: 2.1 time: 0.680562 May 27 15:16:26.243654 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 105/186] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:25 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1322 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:26.480895 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-5d737b24-1be9-4727-a796-e29b22987d8e tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:26.496248 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-5d737b24-1be9-4727-a796-e29b22987d8e tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1313 microversion: 2.1 time: 0.473107 May 27 15:16:26.498810 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 82/187] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:26 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1313 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:26.722991 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-cf59841d-5037-447f-a45c-38f1ab9308c1 req-f801e1e0-494e-4155-98cd-b96de204f170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5603ca92-5c6f-416a-b436-8cc9b66079b5", "tag": "a4f40f1c-633e-47ae-b3fa-ef137d343892"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:26.738522 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-cf59841d-5037-447f-a45c-38f1ab9308c1 req-f801e1e0-494e-4155-98cd-b96de204f170 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:26.738912 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-cf59841d-5037-447f-a45c-38f1ab9308c1 req-f801e1e0-494e-4155-98cd-b96de204f170 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:26.763876 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-cf59841d-5037-447f-a45c-38f1ab9308c1 req-f801e1e0-494e-4155-98cd-b96de204f170 service nova] Creating event network-changed:a4f40f1c-633e-47ae-b3fa-ef137d343892 for instance 5603ca92-5c6f-416a-b436-8cc9b66079b5 on hv-cinder-84254 May 27 15:16:26.771638 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-cf59841d-5037-447f-a45c-38f1ab9308c1 req-f801e1e0-494e-4155-98cd-b96de204f170 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052907 May 27 15:16:26.772746 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 106/188] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:27.264837 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-8ad66bef-caaf-4213-a6a6-c0b7551af802 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:27.265461 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-8ad66bef-caaf-4213-a6a6-c0b7551af802 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:27.273311 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8ad66bef-caaf-4213-a6a6-c0b7551af802 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:27.273759 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8ad66bef-caaf-4213-a6a6-c0b7551af802 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:27.291452 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8ad66bef-caaf-4213-a6a6-c0b7551af802 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:27.296398 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8ad66bef-caaf-4213-a6a6-c0b7551af802 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:27.516285 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-9ecb10d0-a7c5-495c-a14d-d489e94d9cbf tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:27.517106 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-9ecb10d0-a7c5-495c-a14d-d489e94d9cbf tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:27.546316 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9ecb10d0-a7c5-495c-a14d-d489e94d9cbf tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:27.546908 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9ecb10d0-a7c5-495c-a14d-d489e94d9cbf tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:27.547731 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9ecb10d0-a7c5-495c-a14d-d489e94d9cbf tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:27.553993 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9ecb10d0-a7c5-495c-a14d-d489e94d9cbf tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:27.620456 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-8ad66bef-caaf-4213-a6a6-c0b7551af802 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:27.638140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-8ad66bef-caaf-4213-a6a6-c0b7551af802 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1516 microversion: 2.1 time: 0.383113 May 27 15:16:27.639562 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 83/189] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:27 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1516 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:27.661940 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-617db9ee-8138-4759-91a1-da68b58ffedb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:27.662476 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-617db9ee-8138-4759-91a1-da68b58ffedb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:27.683659 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-617db9ee-8138-4759-91a1-da68b58ffedb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:27.685486 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-617db9ee-8138-4759-91a1-da68b58ffedb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:27.686315 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-617db9ee-8138-4759-91a1-da68b58ffedb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:27.686750 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-617db9ee-8138-4759-91a1-da68b58ffedb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:27.760900 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.objects.instance [None req-617db9ee-8138-4759-91a1-da68b58ffedb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lazy-loading 'flavor' on Instance uuid b88bbd4b-d173-4df5-9e19-4fedb81b4aed {{(pid=117743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:16:27.924939 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-9ecb10d0-a7c5-495c-a14d-d489e94d9cbf tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:27.947838 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-9ecb10d0-a7c5-495c-a14d-d489e94d9cbf tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1313 microversion: 2.1 time: 0.437387 May 27 15:16:27.954933 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 107/190] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:27 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:27.963761 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-be4b4ae2-9648-4115-96d7-9bbd96e21056 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:27.976089 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-be4b4ae2-9648-4115-96d7-9bbd96e21056 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:28.005034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-be4b4ae2-9648-4115-96d7-9bbd96e21056 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:28.005554 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-be4b4ae2-9648-4115-96d7-9bbd96e21056 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:28.006429 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-be4b4ae2-9648-4115-96d7-9bbd96e21056 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:28.009318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-be4b4ae2-9648-4115-96d7-9bbd96e21056 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:28.075807 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.objects.instance [None req-be4b4ae2-9648-4115-96d7-9bbd96e21056 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lazy-loading 'flavor' on Instance uuid 5efffda6-ae04-4920-bec6-eabacf6739e8 {{(pid=117742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:16:28.379484 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-be4b4ae2-9648-4115-96d7-9bbd96e21056 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "POST /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8/action" status: 200 len: 32 microversion: 2.1 time: 0.420007 May 27 15:16:28.380177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 108/191] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 15:16:27 2022] POST /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8/action => generated 32 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:16:28.390459 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-a9a89123-99fa-4ff1-aa8b-d77c94f8392c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:28.391416 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-a9a89123-99fa-4ff1-aa8b-d77c94f8392c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:28.412681 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a9a89123-99fa-4ff1-aa8b-d77c94f8392c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:28.418231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a9a89123-99fa-4ff1-aa8b-d77c94f8392c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:28.419188 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a9a89123-99fa-4ff1-aa8b-d77c94f8392c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:28.419644 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a9a89123-99fa-4ff1-aa8b-d77c94f8392c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:28.650864 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-617db9ee-8138-4759-91a1-da68b58ffedb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "POST /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed/action" status: 202 len: 0 microversion: 2.20 time: 1.008537 May 27 15:16:28.667643 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 84/192] 10.222.0.50 () {62 vars in 1318 bytes} [Fri May 27 15:16:27 2022] POST /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed/action => generated 0 bytes in 1027 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 15:16:28.688924 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9b23985f-595c-4c14-a3c5-ee9157be659a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:28.689937 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9b23985f-595c-4c14-a3c5-ee9157be659a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:28.700634 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9b23985f-595c-4c14-a3c5-ee9157be659a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:28.701077 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9b23985f-595c-4c14-a3c5-ee9157be659a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:28.701900 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9b23985f-595c-4c14-a3c5-ee9157be659a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:28.702323 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9b23985f-595c-4c14-a3c5-ee9157be659a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:29.191435 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-a9a89123-99fa-4ff1-aa8b-d77c94f8392c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:29.201624 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-a9a89123-99fa-4ff1-aa8b-d77c94f8392c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.815263 May 27 15:16:29.217562 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 109/193] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:28 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:29.226502 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-5411cbda-892f-4ca7-8db2-eba831a73b26 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:29.231566 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-5411cbda-892f-4ca7-8db2-eba831a73b26 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:29.242252 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5411cbda-892f-4ca7-8db2-eba831a73b26 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:29.245849 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5411cbda-892f-4ca7-8db2-eba831a73b26 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:29.246912 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5411cbda-892f-4ca7-8db2-eba831a73b26 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:29.250361 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5411cbda-892f-4ca7-8db2-eba831a73b26 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:29.416347 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9b23985f-595c-4c14-a3c5-ee9157be659a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:29.434727 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9b23985f-595c-4c14-a3c5-ee9157be659a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:29.436393 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9b23985f-595c-4c14-a3c5-ee9157be659a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:29.440862 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9b23985f-595c-4c14-a3c5-ee9157be659a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1721 microversion: 2.20 time: 0.767249 May 27 15:16:29.444500 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 85/194] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:16:28 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1721 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:16:29.540459 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5411cbda-892f-4ca7-8db2-eba831a73b26 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:29.554816 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-5411cbda-892f-4ca7-8db2-eba831a73b26 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1313 microversion: 2.1 time: 0.335481 May 27 15:16:29.557386 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 110/195] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:29 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:30.232799 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-e22d4599-a2bf-4f54-8800-a4efe004e507 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:30.233589 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-e22d4599-a2bf-4f54-8800-a4efe004e507 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:30.236810 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=2 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:30.262461 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e22d4599-a2bf-4f54-8800-a4efe004e507 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:30.269554 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e22d4599-a2bf-4f54-8800-a4efe004e507 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:30.270384 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e22d4599-a2bf-4f54-8800-a4efe004e507 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:30.270825 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e22d4599-a2bf-4f54-8800-a4efe004e507 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:30.466015 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-50960c14-d25a-49b1-95ad-153068572f07 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:30.468837 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-50960c14-d25a-49b1-95ad-153068572f07 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:30.489216 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-50960c14-d25a-49b1-95ad-153068572f07 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:30.491175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-50960c14-d25a-49b1-95ad-153068572f07 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:30.496287 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-50960c14-d25a-49b1-95ad-153068572f07 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:30.498772 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-50960c14-d25a-49b1-95ad-153068572f07 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:30.567937 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=8 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:30.872968 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-e22d4599-a2bf-4f54-8800-a4efe004e507 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:30.903118 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-e22d4599-a2bf-4f54-8800-a4efe004e507 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.674517 May 27 15:16:30.908378 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 86/196] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:30 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:30.913507 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a9d258bc-36d0-4d78-b3d1-a9e6bed24772 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:30.919517 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a9d258bc-36d0-4d78-b3d1-a9e6bed24772 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:30.939816 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a9d258bc-36d0-4d78-b3d1-a9e6bed24772 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:30.940496 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a9d258bc-36d0-4d78-b3d1-a9e6bed24772 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:30.941313 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a9d258bc-36d0-4d78-b3d1-a9e6bed24772 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:30.941936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a9d258bc-36d0-4d78-b3d1-a9e6bed24772 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:30.987646 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-50960c14-d25a-49b1-95ad-153068572f07 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:30.998768 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-50960c14-d25a-49b1-95ad-153068572f07 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:31.000752 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-50960c14-d25a-49b1-95ad-153068572f07 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:31.002197 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-50960c14-d25a-49b1-95ad-153068572f07 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1721 microversion: 2.20 time: 0.541746 May 27 15:16:31.014470 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 111/197] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:16:30 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1721 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:16:31.577375 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a9d258bc-36d0-4d78-b3d1-a9e6bed24772 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:31.610017 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a9d258bc-36d0-4d78-b3d1-a9e6bed24772 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1313 microversion: 2.1 time: 0.700222 May 27 15:16:31.611076 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 87/198] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:30 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1313 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:31.941826 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-323a9dcc-a4a0-4550-a912-9c54c6ac5500 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:31.942576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-323a9dcc-a4a0-4550-a912-9c54c6ac5500 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:31.960042 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-323a9dcc-a4a0-4550-a912-9c54c6ac5500 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:31.962154 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-323a9dcc-a4a0-4550-a912-9c54c6ac5500 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:31.963014 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-323a9dcc-a4a0-4550-a912-9c54c6ac5500 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:31.966619 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-323a9dcc-a4a0-4550-a912-9c54c6ac5500 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:32.022544 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-2c188b00-ebc2-4212-be1e-37d0520d5e5f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:32.023604 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-2c188b00-ebc2-4212-be1e-37d0520d5e5f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:32.063612 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2c188b00-ebc2-4212-be1e-37d0520d5e5f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:32.064059 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2c188b00-ebc2-4212-be1e-37d0520d5e5f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:32.064835 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2c188b00-ebc2-4212-be1e-37d0520d5e5f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:32.065269 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2c188b00-ebc2-4212-be1e-37d0520d5e5f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:32.527327 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-323a9dcc-a4a0-4550-a912-9c54c6ac5500 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:32.532397 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-2c188b00-ebc2-4212-be1e-37d0520d5e5f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:32.538034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-323a9dcc-a4a0-4550-a912-9c54c6ac5500 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.622201 May 27 15:16:32.538702 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 112/199] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:31 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:32.550730 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ce8ea06d-a187-4a07-b435-be0ddd0209b3 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Action: 'create', calling method: .version_select at 0x7f57e1afd0d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1655432015", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMatk1V0joQCSWEuq8nYk+dpJbBcub07xvDRtpUBWhnSMm+xBJXk2jv8pUsPSB0kdnSosBmSR95mc9O8g8seusvoQU05BfJ1TWXHz2rWRT0MKkQZoNGO0o2C+Upb+SVEFQ=="}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:32.570156 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-2c188b00-ebc2-4212-be1e-37d0520d5e5f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:32.571394 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-ce8ea06d-a187-4a07-b435-be0ddd0209b3 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Getting quotas for project 7facd29ad0d746099537a1b1345c2c90. Resources: {'key_pairs'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:16:32.572252 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-2c188b00-ebc2-4212-be1e-37d0520d5e5f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:32.573867 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-2c188b00-ebc2-4212-be1e-37d0520d5e5f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1721 microversion: 2.20 time: 0.555666 May 27 15:16:32.576835 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-ce8ea06d-a187-4a07-b435-be0ddd0209b3 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Getting quotas for user 50ca9d699b004df4becfe3241802fb17 and project 7facd29ad0d746099537a1b1345c2c90. Resources: {'key_pairs'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:16:32.577519 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 88/200] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:16:32 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1721 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:16:32.605481 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ce8ea06d-a187-4a07-b435-be0ddd0209b3 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.065650 May 27 15:16:32.606093 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 113/201] 10.222.0.50 () {60 vars in 1158 bytes} [Fri May 27 15:16:32 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:32.628466 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-fe7ad22b-976b-437f-b3f6-acea93401f4e tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:32.629806 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-fe7ad22b-976b-437f-b3f6-acea93401f4e tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:32.643162 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fe7ad22b-976b-437f-b3f6-acea93401f4e tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:32.646325 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fe7ad22b-976b-437f-b3f6-acea93401f4e tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:32.647831 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fe7ad22b-976b-437f-b3f6-acea93401f4e tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:32.650704 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fe7ad22b-976b-437f-b3f6-acea93401f4e tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:32.819981 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-7b86115c-d8bc-467e-bc43-a42c52b8ab21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-333825876", "imageRef": "14bb00dc-531c-45e8-bacd-25faf1587ea7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1655432015", "networks": [{"uuid": "0dee0eec-46a3-47c8-be75-0a73396ec240"}]}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:32.863199 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-fe7ad22b-976b-437f-b3f6-acea93401f4e tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:32.871854 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-fe7ad22b-976b-437f-b3f6-acea93401f4e tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1313 microversion: 2.1 time: 0.247820 May 27 15:16:32.881885 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 89/202] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:32 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:32.888740 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.network.neutron [None req-7b86115c-d8bc-467e-bc43-a42c52b8ab21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] validate_networks() for [('0dee0eec-46a3-47c8-be75-0a73396ec240', None, None, None, None, None)] {{(pid=117742) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:16:33.555839 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-faf26f72-47f7-476a-9dc6-8965816b5b2d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:33.556370 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-faf26f72-47f7-476a-9dc6-8965816b5b2d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:33.563578 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-faf26f72-47f7-476a-9dc6-8965816b5b2d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:33.564037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-faf26f72-47f7-476a-9dc6-8965816b5b2d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:33.564819 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-faf26f72-47f7-476a-9dc6-8965816b5b2d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:33.565261 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-faf26f72-47f7-476a-9dc6-8965816b5b2d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:33.654792 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-7b86115c-d8bc-467e-bc43-a42c52b8ab21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Flavor limits 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:16:33.656097 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-7b86115c-d8bc-467e-bc43-a42c52b8ab21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Image limits 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:16:33.656663 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-7b86115c-d8bc-467e-bc43-a42c52b8ab21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Flavor pref 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:16:33.657147 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-7b86115c-d8bc-467e-bc43-a42c52b8ab21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Image pref 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:16:33.657664 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-7b86115c-d8bc-467e-bc43-a42c52b8ab21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:16:33.684365 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7b86115c-d8bc-467e-bc43-a42c52b8ab21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:33.688377 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7b86115c-d8bc-467e-bc43-a42c52b8ab21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:33.695090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7b86115c-d8bc-467e-bc43-a42c52b8ab21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:33.696441 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7b86115c-d8bc-467e-bc43-a42c52b8ab21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:33.737842 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-7b86115c-d8bc-467e-bc43-a42c52b8ab21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Getting quotas for project 7facd29ad0d746099537a1b1345c2c90. Resources: {'cores', 'ram', 'instances'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:16:33.750735 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-7b86115c-d8bc-467e-bc43-a42c52b8ab21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Getting quotas for user 50ca9d699b004df4becfe3241802fb17 and project 7facd29ad0d746099537a1b1345c2c90. Resources: {'cores', 'ram', 'instances'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:16:33.757430 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-faf26f72-47f7-476a-9dc6-8965816b5b2d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:33.767590 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-faf26f72-47f7-476a-9dc6-8965816b5b2d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.215805 May 27 15:16:33.768329 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 90/203] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:33 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:33.775472 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-071cf2c0-b5bb-417f-bcdb-77dd07ef07fc tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:33.776363 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-071cf2c0-b5bb-417f-bcdb-77dd07ef07fc tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:33.778979 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-7b86115c-d8bc-467e-bc43-a42c52b8ab21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Going to run 1 instances... {{(pid=117742) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:16:33.784315 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-071cf2c0-b5bb-417f-bcdb-77dd07ef07fc tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:33.785221 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-071cf2c0-b5bb-417f-bcdb-77dd07ef07fc tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:33.785703 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-7b86115c-d8bc-467e-bc43-a42c52b8ab21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='14bb00dc-531c-45e8-bacd-25faf1587ea7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117742) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:16:33.786313 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-071cf2c0-b5bb-417f-bcdb-77dd07ef07fc tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:33.787152 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-071cf2c0-b5bb-417f-bcdb-77dd07ef07fc tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:33.887528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-7b86115c-d8bc-467e-bc43-a42c52b8ab21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.077728 May 27 15:16:33.895330 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 114/204] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 15:16:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:16:33.904683 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-54f84fb7-809d-4909-a97d-5a35e0b946cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:33.907611 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-54f84fb7-809d-4909-a97d-5a35e0b946cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:33.917758 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-54f84fb7-809d-4909-a97d-5a35e0b946cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:33.927886 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-54f84fb7-809d-4909-a97d-5a35e0b946cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:33.928822 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-54f84fb7-809d-4909-a97d-5a35e0b946cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:33.929262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-54f84fb7-809d-4909-a97d-5a35e0b946cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:34.092946 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-071cf2c0-b5bb-417f-bcdb-77dd07ef07fc tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:34.108865 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-071cf2c0-b5bb-417f-bcdb-77dd07ef07fc tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:34.110391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-071cf2c0-b5bb-417f-bcdb-77dd07ef07fc tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:34.139524 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-071cf2c0-b5bb-417f-bcdb-77dd07ef07fc tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1721 microversion: 2.20 time: 0.367974 May 27 15:16:34.145150 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 91/205] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:16:33 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1721 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:34.172020 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b27aff0a-49a3-4fff-abc3-a48e22194ce5 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:34.178017 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b27aff0a-49a3-4fff-abc3-a48e22194ce5 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:34.449668 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b27aff0a-49a3-4fff-abc3-a48e22194ce5 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:34.466151 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b27aff0a-49a3-4fff-abc3-a48e22194ce5 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1258 microversion: 2.1 time: 0.319894 May 27 15:16:34.467219 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 92/206] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:34 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1258 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:34.525744 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-54f84fb7-809d-4909-a97d-5a35e0b946cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:34.541321 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-54f84fb7-809d-4909-a97d-5a35e0b946cb tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1313 microversion: 2.1 time: 0.643187 May 27 15:16:34.542151 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 115/207] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:33 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1313 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:34.565431 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9b23224b-23ee-44b7-9067-e5c5429ba0e9 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:34.573748 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9b23224b-23ee-44b7-9067-e5c5429ba0e9 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:34.574400 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9b23224b-23ee-44b7-9067-e5c5429ba0e9 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:34.664168 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9b23224b-23ee-44b7-9067-e5c5429ba0e9 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Going to try to stop instance {{(pid=117743) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 15:16:34.711331 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:34.781259 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9b23224b-23ee-44b7-9067-e5c5429ba0e9 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "POST /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27/action" status: 202 len: 0 microversion: 2.1 time: 0.218775 May 27 15:16:34.786813 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 93/208] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 15:16:34 2022] POST /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:16:34.801408 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-267acf31-b8e9-4efd-a266-47d4b05e7a24 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:34.802082 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-267acf31-b8e9-4efd-a266-47d4b05e7a24 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:34.819369 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9d454da6-0210-4f28-b994-420d8cd17785 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:34.822184 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9d454da6-0210-4f28-b994-420d8cd17785 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:34.832004 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-267acf31-b8e9-4efd-a266-47d4b05e7a24 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:34.832893 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-267acf31-b8e9-4efd-a266-47d4b05e7a24 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:34.833896 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-267acf31-b8e9-4efd-a266-47d4b05e7a24 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:34.834586 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-267acf31-b8e9-4efd-a266-47d4b05e7a24 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:34.847033 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9d454da6-0210-4f28-b994-420d8cd17785 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:34.848941 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9d454da6-0210-4f28-b994-420d8cd17785 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:34.851807 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9d454da6-0210-4f28-b994-420d8cd17785 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:34.853417 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9d454da6-0210-4f28-b994-420d8cd17785 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:35.171800 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9d454da6-0210-4f28-b994-420d8cd17785 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:35.189442 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-267acf31-b8e9-4efd-a266-47d4b05e7a24 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:35.191422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9d454da6-0210-4f28-b994-420d8cd17785 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1724 microversion: 2.1 time: 0.393136 May 27 15:16:35.192849 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 94/209] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:34 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1724 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:35.198451 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-267acf31-b8e9-4efd-a266-47d4b05e7a24 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.417179 May 27 15:16:35.199281 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 116/210] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:34 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:35.214157 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-84516986-ea21-4752-b75d-b7083ae6a436 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:35.214157 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-84516986-ea21-4752-b75d-b7083ae6a436 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:35.240213 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-84516986-ea21-4752-b75d-b7083ae6a436 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:35.240668 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-84516986-ea21-4752-b75d-b7083ae6a436 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:35.243597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-84516986-ea21-4752-b75d-b7083ae6a436 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:35.244060 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-84516986-ea21-4752-b75d-b7083ae6a436 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:35.488461 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-00b1a6ce-481b-4b83-b34a-d8e6c8d3adf1 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:35.489973 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-00b1a6ce-481b-4b83-b34a-d8e6c8d3adf1 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:35.516168 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-00b1a6ce-481b-4b83-b34a-d8e6c8d3adf1 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:35.521375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-00b1a6ce-481b-4b83-b34a-d8e6c8d3adf1 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:35.524369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-00b1a6ce-481b-4b83-b34a-d8e6c8d3adf1 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:35.529805 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-00b1a6ce-481b-4b83-b34a-d8e6c8d3adf1 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:35.543063 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:35.633364 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-84516986-ea21-4752-b75d-b7083ae6a436 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:35.642760 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-84516986-ea21-4752-b75d-b7083ae6a436 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:35.648085 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-84516986-ea21-4752-b75d-b7083ae6a436 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:35.654422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-84516986-ea21-4752-b75d-b7083ae6a436 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1721 microversion: 2.20 time: 0.455972 May 27 15:16:35.655255 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 95/211] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:16:35 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1721 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:35.668791 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-2577d2ac-2165-471a-872b-fc41725183fe tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:35.670018 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-2577d2ac-2165-471a-872b-fc41725183fe tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:35.677374 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2577d2ac-2165-471a-872b-fc41725183fe tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:35.678524 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2577d2ac-2165-471a-872b-fc41725183fe tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:35.679751 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2577d2ac-2165-471a-872b-fc41725183fe tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:35.680583 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2577d2ac-2165-471a-872b-fc41725183fe tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:35.710521 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-00b1a6ce-481b-4b83-b34a-d8e6c8d3adf1 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:35.723199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-00b1a6ce-481b-4b83-b34a-d8e6c8d3adf1 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1310 microversion: 2.1 time: 0.241183 May 27 15:16:35.724953 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 117/212] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:35 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1310 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:35.887981 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-2577d2ac-2165-471a-872b-fc41725183fe tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:35.897149 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-2577d2ac-2165-471a-872b-fc41725183fe tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1313 microversion: 2.1 time: 0.238213 May 27 15:16:35.897745 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 96/213] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:35 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:36.209541 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-a1640096-6308-46cd-91b2-e2e768653189 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:36.213327 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-a1640096-6308-46cd-91b2-e2e768653189 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:36.218994 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-2c76cbe1-c5e1-4c6e-95d5-6d8969d3b014 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:36.219664 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-2c76cbe1-c5e1-4c6e-95d5-6d8969d3b014 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:36.225536 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a1640096-6308-46cd-91b2-e2e768653189 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:36.228857 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a1640096-6308-46cd-91b2-e2e768653189 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:36.232087 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a1640096-6308-46cd-91b2-e2e768653189 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:36.232811 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a1640096-6308-46cd-91b2-e2e768653189 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:36.238284 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2c76cbe1-c5e1-4c6e-95d5-6d8969d3b014 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:36.245743 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2c76cbe1-c5e1-4c6e-95d5-6d8969d3b014 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:36.247574 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2c76cbe1-c5e1-4c6e-95d5-6d8969d3b014 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:36.249176 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2c76cbe1-c5e1-4c6e-95d5-6d8969d3b014 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:36.747811 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-2c76cbe1-c5e1-4c6e-95d5-6d8969d3b014 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:36.759810 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-2c76cbe1-c5e1-4c6e-95d5-6d8969d3b014 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.544581 May 27 15:16:36.762959 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 97/214] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:36 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:36.775775 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-4f6f9655-5393-433e-aed3-4880c3f6d984 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:36.779560 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-4f6f9655-5393-433e-aed3-4880c3f6d984 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:36.789411 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4f6f9655-5393-433e-aed3-4880c3f6d984 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:36.790086 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4f6f9655-5393-433e-aed3-4880c3f6d984 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:36.791182 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4f6f9655-5393-433e-aed3-4880c3f6d984 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:36.792020 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4f6f9655-5393-433e-aed3-4880c3f6d984 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:36.823959 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-a1640096-6308-46cd-91b2-e2e768653189 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:36.834145 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-a1640096-6308-46cd-91b2-e2e768653189 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1724 microversion: 2.1 time: 0.628397 May 27 15:16:36.838767 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 118/215] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:36 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1724 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:36.849698 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-d91eadb8-24c2-4004-becd-0a1715661c2c req-5e5bd881-f920-4fa1-875a-9b7b123a8afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5603ca92-5c6f-416a-b436-8cc9b66079b5", "name": "network-vif-plugged", "status": "completed", "tag": "a4f40f1c-633e-47ae-b3fa-ef137d343892"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:36.862107 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-d91eadb8-24c2-4004-becd-0a1715661c2c req-5e5bd881-f920-4fa1-875a-9b7b123a8afd service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:36.862827 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-d91eadb8-24c2-4004-becd-0a1715661c2c req-5e5bd881-f920-4fa1-875a-9b7b123a8afd service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:36.876331 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-d91eadb8-24c2-4004-becd-0a1715661c2c req-5e5bd881-f920-4fa1-875a-9b7b123a8afd service nova] Creating event network-vif-plugged:a4f40f1c-633e-47ae-b3fa-ef137d343892 for instance 5603ca92-5c6f-416a-b436-8cc9b66079b5 on hv-cinder-84254 May 27 15:16:36.881936 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-d91eadb8-24c2-4004-becd-0a1715661c2c req-5e5bd881-f920-4fa1-875a-9b7b123a8afd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041677 May 27 15:16:36.882777 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 119/216] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:36.892040 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-2ba1b3fa-5194-4e85-acbe-9df5abc88394 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:36.892959 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-2ba1b3fa-5194-4e85-acbe-9df5abc88394 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:36.899562 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2ba1b3fa-5194-4e85-acbe-9df5abc88394 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:36.900287 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2ba1b3fa-5194-4e85-acbe-9df5abc88394 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:36.901280 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2ba1b3fa-5194-4e85-acbe-9df5abc88394 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:36.901910 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2ba1b3fa-5194-4e85-acbe-9df5abc88394 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:37.392346 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-2ba1b3fa-5194-4e85-acbe-9df5abc88394 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:37.402709 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-2ba1b3fa-5194-4e85-acbe-9df5abc88394 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1316 microversion: 2.1 time: 0.517928 May 27 15:16:37.405683 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 120/217] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:36 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1316 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:37.602073 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-4f6f9655-5393-433e-aed3-4880c3f6d984 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:37.618098 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-4f6f9655-5393-433e-aed3-4880c3f6d984 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:37.620683 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-4f6f9655-5393-433e-aed3-4880c3f6d984 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:37.622289 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-4f6f9655-5393-433e-aed3-4880c3f6d984 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1721 microversion: 2.20 time: 0.857048 May 27 15:16:37.623160 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 98/218] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:16:36 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1721 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:37.628871 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-e050fca2-3fcc-467b-88d0-75ed7ea192d8 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:37.629720 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-e050fca2-3fcc-467b-88d0-75ed7ea192d8 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:37.641151 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e050fca2-3fcc-467b-88d0-75ed7ea192d8 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:37.641876 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e050fca2-3fcc-467b-88d0-75ed7ea192d8 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:37.642933 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e050fca2-3fcc-467b-88d0-75ed7ea192d8 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:37.643528 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e050fca2-3fcc-467b-88d0-75ed7ea192d8 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:37.916179 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-342bc147-1cc7-4bc0-8b5a-d73c57fd7f19 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Action: 'create', calling method: .version_select at 0x7f57e412f3a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-504926628", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTlNjk1pEROXPN1eHCNNaNjWpzB22VcMYrfaHIP6iYS/Cy8fcSVRcCeA1PJSCpyRW7uSX3Mws6jnAaHBI8yBybLPOVGDNaekOXVOE3NNa+EQfaPJE3LYYS2RfWbP4CVdQ=="}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:37.972773 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-e050fca2-3fcc-467b-88d0-75ed7ea192d8 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:37.994164 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-342bc147-1cc7-4bc0-8b5a-d73c57fd7f19 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Getting quotas for project f88bb4c8b75c4ad6be62f2cf5cf509c4. Resources: {'key_pairs'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:16:37.997995 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-e050fca2-3fcc-467b-88d0-75ed7ea192d8 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1313 microversion: 2.1 time: 0.373209 May 27 15:16:38.000953 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 99/219] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:37 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:38.012659 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-342bc147-1cc7-4bc0-8b5a-d73c57fd7f19 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Getting quotas for user af74115f423c43fdb2544876be4e5622 and project f88bb4c8b75c4ad6be62f2cf5cf509c4. Resources: {'key_pairs'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:16:38.020269 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-4923338b-389e-484c-8431-cbba0d6aab4b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:38.021364 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-4923338b-389e-484c-8431-cbba0d6aab4b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:38.058730 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4923338b-389e-484c-8431-cbba0d6aab4b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:38.063110 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4923338b-389e-484c-8431-cbba0d6aab4b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:38.067197 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4923338b-389e-484c-8431-cbba0d6aab4b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:38.068160 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4923338b-389e-484c-8431-cbba0d6aab4b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:38.074409 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-342bc147-1cc7-4bc0-8b5a-d73c57fd7f19 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.665890 May 27 15:16:38.078157 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 121/220] 10.222.0.50 () {60 vars in 1158 bytes} [Fri May 27 15:16:37 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:38.101576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-093e8c36-fabe-4aa2-b401-ebe7766d66bb tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:38.109048 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-093e8c36-fabe-4aa2-b401-ebe7766d66bb tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:38.152276 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-093e8c36-fabe-4aa2-b401-ebe7766d66bb tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:38.156492 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-093e8c36-fabe-4aa2-b401-ebe7766d66bb tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:38.157342 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-093e8c36-fabe-4aa2-b401-ebe7766d66bb tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:38.157789 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-093e8c36-fabe-4aa2-b401-ebe7766d66bb tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:38.695143 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-4923338b-389e-484c-8431-cbba0d6aab4b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:38.705071 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-4923338b-389e-484c-8431-cbba0d6aab4b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.697686 May 27 15:16:38.712014 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 100/221] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:38 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:38.717809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9e2dae05-a603-40b0-aca6-dd30c5616aa0 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:38.722100 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9e2dae05-a603-40b0-aca6-dd30c5616aa0 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:38.769051 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9e2dae05-a603-40b0-aca6-dd30c5616aa0 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:38.775500 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9e2dae05-a603-40b0-aca6-dd30c5616aa0 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:38.776789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9e2dae05-a603-40b0-aca6-dd30c5616aa0 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:38.779812 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9e2dae05-a603-40b0-aca6-dd30c5616aa0 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:38.975282 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-093e8c36-fabe-4aa2-b401-ebe7766d66bb tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:38.988314 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-093e8c36-fabe-4aa2-b401-ebe7766d66bb tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1724 microversion: 2.1 time: 0.906560 May 27 15:16:38.999295 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 122/222] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:38 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1724 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:39.005196 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-a7d6781c-ab1a-43cf-b91c-546343f50ee6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:39.006979 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-a7d6781c-ab1a-43cf-b91c-546343f50ee6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:39.022955 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a7d6781c-ab1a-43cf-b91c-546343f50ee6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:39.023620 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a7d6781c-ab1a-43cf-b91c-546343f50ee6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:39.027691 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a7d6781c-ab1a-43cf-b91c-546343f50ee6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:39.028152 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a7d6781c-ab1a-43cf-b91c-546343f50ee6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:39.276402 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9e2dae05-a603-40b0-aca6-dd30c5616aa0 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:39.287629 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9e2dae05-a603-40b0-aca6-dd30c5616aa0 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.574350 May 27 15:16:39.288542 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 101/223] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:38 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:39.327531 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-727296a6-7080-450a-9656-d02018986a22 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:39.333274 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-727296a6-7080-450a-9656-d02018986a22 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:39.342899 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-727296a6-7080-450a-9656-d02018986a22 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:39.343948 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-727296a6-7080-450a-9656-d02018986a22 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:39.345302 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-727296a6-7080-450a-9656-d02018986a22 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:39.346715 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-727296a6-7080-450a-9656-d02018986a22 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:39.350765 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-a7d6781c-ab1a-43cf-b91c-546343f50ee6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:39.368262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-a7d6781c-ab1a-43cf-b91c-546343f50ee6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:39.371077 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-a7d6781c-ab1a-43cf-b91c-546343f50ee6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:39.374624 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-a7d6781c-ab1a-43cf-b91c-546343f50ee6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1721 microversion: 2.20 time: 0.380572 May 27 15:16:39.377310 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 123/224] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:16:38 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1721 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:39.592234 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-727296a6-7080-450a-9656-d02018986a22 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:39.606125 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-727296a6-7080-450a-9656-d02018986a22 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1313 microversion: 2.1 time: 0.293212 May 27 15:16:39.607636 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 102/225] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:39 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:39.729918 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-abee78f7-96d3-4f14-85c2-baab85351eb7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:39.731202 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-abee78f7-96d3-4f14-85c2-baab85351eb7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:39.746403 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-abee78f7-96d3-4f14-85c2-baab85351eb7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:39.747544 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-abee78f7-96d3-4f14-85c2-baab85351eb7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:39.749956 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-abee78f7-96d3-4f14-85c2-baab85351eb7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:39.754607 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-abee78f7-96d3-4f14-85c2-baab85351eb7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:40.005605 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-12715bcd-7b95-4029-8b73-fd00a5892730 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:40.006215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-12715bcd-7b95-4029-8b73-fd00a5892730 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:40.016956 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-12715bcd-7b95-4029-8b73-fd00a5892730 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:40.019449 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-12715bcd-7b95-4029-8b73-fd00a5892730 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:40.021271 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-12715bcd-7b95-4029-8b73-fd00a5892730 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:40.025891 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-12715bcd-7b95-4029-8b73-fd00a5892730 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:40.122898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-abee78f7-96d3-4f14-85c2-baab85351eb7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:40.134582 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-abee78f7-96d3-4f14-85c2-baab85351eb7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.411192 May 27 15:16:40.137926 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 124/226] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:39 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:40.305890 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f9136a6c-0e70-486d-878b-a188e674db76 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:40.306774 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f9136a6c-0e70-486d-878b-a188e674db76 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:40.318416 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f9136a6c-0e70-486d-878b-a188e674db76 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:40.318885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f9136a6c-0e70-486d-878b-a188e674db76 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:40.324089 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f9136a6c-0e70-486d-878b-a188e674db76 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:40.324552 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f9136a6c-0e70-486d-878b-a188e674db76 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:40.367472 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-12715bcd-7b95-4029-8b73-fd00a5892730 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:40.377463 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-12715bcd-7b95-4029-8b73-fd00a5892730 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1724 microversion: 2.1 time: 0.375131 May 27 15:16:40.389650 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 103/227] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:40 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1724 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:40.412803 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-2885a686-caf2-4fe8-840d-48b839b3ae38 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:40.413676 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-2885a686-caf2-4fe8-840d-48b839b3ae38 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:40.436601 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2885a686-caf2-4fe8-840d-48b839b3ae38 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:40.442308 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2885a686-caf2-4fe8-840d-48b839b3ae38 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:40.443846 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2885a686-caf2-4fe8-840d-48b839b3ae38 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:40.444441 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2885a686-caf2-4fe8-840d-48b839b3ae38 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:40.699074 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-2885a686-caf2-4fe8-840d-48b839b3ae38 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:40.710121 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-2885a686-caf2-4fe8-840d-48b839b3ae38 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:40.717303 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-2885a686-caf2-4fe8-840d-48b839b3ae38 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:40.722788 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-2885a686-caf2-4fe8-840d-48b839b3ae38 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1721 microversion: 2.20 time: 0.325418 May 27 15:16:40.723597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 104/228] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:16:40 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1721 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:40.734610 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-63fbc8a2-ea6c-4c1b-9b00-72fa1bd07371 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:40.735408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-63fbc8a2-ea6c-4c1b-9b00-72fa1bd07371 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:40.750253 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-63fbc8a2-ea6c-4c1b-9b00-72fa1bd07371 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:40.750977 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-63fbc8a2-ea6c-4c1b-9b00-72fa1bd07371 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:40.751915 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-63fbc8a2-ea6c-4c1b-9b00-72fa1bd07371 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:40.752493 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-63fbc8a2-ea6c-4c1b-9b00-72fa1bd07371 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:40.955824 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f9136a6c-0e70-486d-878b-a188e674db76 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:40.965010 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f9136a6c-0e70-486d-878b-a188e674db76 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.663181 May 27 15:16:40.970998 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 125/229] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:40 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:41.059487 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-63fbc8a2-ea6c-4c1b-9b00-72fa1bd07371 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:41.062653 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-63fbc8a2-ea6c-4c1b-9b00-72fa1bd07371 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1313 microversion: 2.1 time: 0.337590 May 27 15:16:41.068486 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 105/230] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:40 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:41.157562 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-4d14257b-4e89-434d-815e-061979557aaf tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:41.158762 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-4d14257b-4e89-434d-815e-061979557aaf tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:41.174629 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:41.181787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4d14257b-4e89-434d-815e-061979557aaf tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:41.184592 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4d14257b-4e89-434d-815e-061979557aaf tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:41.187498 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4d14257b-4e89-434d-815e-061979557aaf tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:41.192190 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4d14257b-4e89-434d-815e-061979557aaf tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:41.397577 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-eefceeee-2d8a-4268-bd73-0f3a882611db tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:41.398340 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-eefceeee-2d8a-4268-bd73-0f3a882611db tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:41.425079 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-eefceeee-2d8a-4268-bd73-0f3a882611db tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:41.429991 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-eefceeee-2d8a-4268-bd73-0f3a882611db tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:41.436394 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-eefceeee-2d8a-4268-bd73-0f3a882611db tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:41.438240 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-eefceeee-2d8a-4268-bd73-0f3a882611db tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:41.694722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-4d14257b-4e89-434d-815e-061979557aaf tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:41.705648 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-4d14257b-4e89-434d-815e-061979557aaf tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.555652 May 27 15:16:41.722280 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 126/231] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:41 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:41.743466 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-6397dbc9-8dc9-46a5-9b6d-f4a786648c18 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:41.745551 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-6397dbc9-8dc9-46a5-9b6d-f4a786648c18 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:41.765308 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6397dbc9-8dc9-46a5-9b6d-f4a786648c18 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:41.767327 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6397dbc9-8dc9-46a5-9b6d-f4a786648c18 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:41.768374 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6397dbc9-8dc9-46a5-9b6d-f4a786648c18 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:41.773774 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6397dbc9-8dc9-46a5-9b6d-f4a786648c18 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:42.057021 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-eefceeee-2d8a-4268-bd73-0f3a882611db tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:42.067986 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-eefceeee-2d8a-4268-bd73-0f3a882611db tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1724 microversion: 2.1 time: 0.675098 May 27 15:16:42.087688 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 106/232] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:41 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1724 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:42.092815 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-324f1e17-714c-4336-8ee6-2055ad85297b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:42.093885 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-324f1e17-714c-4336-8ee6-2055ad85297b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:42.107484 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-324f1e17-714c-4336-8ee6-2055ad85297b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:42.108213 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-324f1e17-714c-4336-8ee6-2055ad85297b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:42.109239 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-324f1e17-714c-4336-8ee6-2055ad85297b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:42.109934 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-324f1e17-714c-4336-8ee6-2055ad85297b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:42.215288 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6397dbc9-8dc9-46a5-9b6d-f4a786648c18 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:42.237579 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6397dbc9-8dc9-46a5-9b6d-f4a786648c18 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:42.244186 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6397dbc9-8dc9-46a5-9b6d-f4a786648c18 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:42.245953 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-6397dbc9-8dc9-46a5-9b6d-f4a786648c18 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1721 microversion: 2.20 time: 0.508246 May 27 15:16:42.248456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 127/233] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:16:41 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1721 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:16:42.257366 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e22120f4-b72d-4461-861b-ce357f39d717 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:42.258805 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e22120f4-b72d-4461-861b-ce357f39d717 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:42.299410 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e22120f4-b72d-4461-861b-ce357f39d717 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:42.302803 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e22120f4-b72d-4461-861b-ce357f39d717 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:42.304097 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e22120f4-b72d-4461-861b-ce357f39d717 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:42.304776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e22120f4-b72d-4461-861b-ce357f39d717 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:42.586021 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-324f1e17-714c-4336-8ee6-2055ad85297b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:42.603948 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-324f1e17-714c-4336-8ee6-2055ad85297b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.509795 May 27 15:16:42.604928 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 107/234] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:42 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:42.727945 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9e7647bb-5fd9-4a63-bfa0-ef2a08e9f8f9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:42.728949 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9e7647bb-5fd9-4a63-bfa0-ef2a08e9f8f9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:42.737215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:42.741298 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-e22120f4-b72d-4461-861b-ce357f39d717 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:42.742189 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9e7647bb-5fd9-4a63-bfa0-ef2a08e9f8f9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:42.743079 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9e7647bb-5fd9-4a63-bfa0-ef2a08e9f8f9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:42.746374 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9e7647bb-5fd9-4a63-bfa0-ef2a08e9f8f9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:42.747303 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9e7647bb-5fd9-4a63-bfa0-ef2a08e9f8f9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:42.750300 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-e22120f4-b72d-4461-861b-ce357f39d717 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1496 microversion: 2.1 time: 0.499070 May 27 15:16:42.766138 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 128/235] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:42 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1496 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:43.101786 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-d877dd72-a431-4294-9dab-bbc510c0b8a1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:43.104321 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-d877dd72-a431-4294-9dab-bbc510c0b8a1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:43.146088 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d877dd72-a431-4294-9dab-bbc510c0b8a1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:43.167923 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d877dd72-a431-4294-9dab-bbc510c0b8a1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:43.167923 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d877dd72-a431-4294-9dab-bbc510c0b8a1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:43.167923 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d877dd72-a431-4294-9dab-bbc510c0b8a1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:43.701906 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9e7647bb-5fd9-4a63-bfa0-ef2a08e9f8f9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:43.719603 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9e7647bb-5fd9-4a63-bfa0-ef2a08e9f8f9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.995811 May 27 15:16:43.720597 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=2 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:43.735008 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 108/236] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:42 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:43.748366 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-2b14b50c-e480-4e47-8861-2a309dac99d6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:43.749640 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-2b14b50c-e480-4e47-8861-2a309dac99d6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:43.762160 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2b14b50c-e480-4e47-8861-2a309dac99d6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:43.763030 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2b14b50c-e480-4e47-8861-2a309dac99d6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:43.764774 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2b14b50c-e480-4e47-8861-2a309dac99d6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:43.765706 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2b14b50c-e480-4e47-8861-2a309dac99d6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:43.925449 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-d877dd72-a431-4294-9dab-bbc510c0b8a1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:43.945984 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-d877dd72-a431-4294-9dab-bbc510c0b8a1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1724 microversion: 2.1 time: 0.861044 May 27 15:16:43.947688 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 129/237] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:43 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1724 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:43.977868 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-6b404cc9-244e-47b1-a9c1-0a83fb43547d tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:43.978972 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-6b404cc9-244e-47b1-a9c1-0a83fb43547d tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:43.991800 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6b404cc9-244e-47b1-a9c1-0a83fb43547d tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:43.997716 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6b404cc9-244e-47b1-a9c1-0a83fb43547d tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:43.998999 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6b404cc9-244e-47b1-a9c1-0a83fb43547d tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:43.999938 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6b404cc9-244e-47b1-a9c1-0a83fb43547d tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:44.438521 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-2b14b50c-e480-4e47-8861-2a309dac99d6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:44.449465 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:44.455656 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=2 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:44.480976 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-2b14b50c-e480-4e47-8861-2a309dac99d6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:44.502245 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-2b14b50c-e480-4e47-8861-2a309dac99d6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:44.503765 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-2b14b50c-e480-4e47-8861-2a309dac99d6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1721 microversion: 2.20 time: 0.771802 May 27 15:16:44.516966 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 109/238] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:16:43 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1721 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:44.530012 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-4964335a-39e0-49d9-9d93-03d7975b4e42 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:44.531624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-4964335a-39e0-49d9-9d93-03d7975b4e42 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:44.549516 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4964335a-39e0-49d9-9d93-03d7975b4e42 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:44.552241 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4964335a-39e0-49d9-9d93-03d7975b4e42 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:44.553097 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4964335a-39e0-49d9-9d93-03d7975b4e42 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:44.555187 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4964335a-39e0-49d9-9d93-03d7975b4e42 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:44.635515 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-4964335a-39e0-49d9-9d93-03d7975b4e42 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Going to try to terminate instance {{(pid=117743) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:16:44.711776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6b404cc9-244e-47b1-a9c1-0a83fb43547d tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:44.728280 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-6b404cc9-244e-47b1-a9c1-0a83fb43547d tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.775447 May 27 15:16:44.734698 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 130/239] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:43 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:44.748305 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-c2f31079-6e2a-4a6d-910c-ebae52003074 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:44.757049 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-c2f31079-6e2a-4a6d-910c-ebae52003074 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:44.770084 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c2f31079-6e2a-4a6d-910c-ebae52003074 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:44.775114 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c2f31079-6e2a-4a6d-910c-ebae52003074 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:44.778983 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-4964335a-39e0-49d9-9d93-03d7975b4e42 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 204 len: 0 microversion: 2.1 time: 0.258964 May 27 15:16:44.779641 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c2f31079-6e2a-4a6d-910c-ebae52003074 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:44.779956 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c2f31079-6e2a-4a6d-910c-ebae52003074 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:44.780747 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 110/240] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:16:44 2022] DELETE /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:16:44.792141 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-94688cfe-c0a5-4a36-8459-99162fd1e55b tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:44.803949 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-94688cfe-c0a5-4a36-8459-99162fd1e55b tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:44.810625 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-94688cfe-c0a5-4a36-8459-99162fd1e55b tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:44.811755 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-94688cfe-c0a5-4a36-8459-99162fd1e55b tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:44.812896 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-94688cfe-c0a5-4a36-8459-99162fd1e55b tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:44.813619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-94688cfe-c0a5-4a36-8459-99162fd1e55b tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:45.211155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-c2f31079-6e2a-4a6d-910c-ebae52003074 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:45.225165 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-c2f31079-6e2a-4a6d-910c-ebae52003074 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.477994 May 27 15:16:45.230154 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 131/241] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:44 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:45.244891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f701ce77-1f2b-4808-a925-f10e6dcdaba5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:45.245513 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f701ce77-1f2b-4808-a925-f10e6dcdaba5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:45.254208 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-94688cfe-c0a5-4a36-8459-99162fd1e55b tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:45.275548 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-94688cfe-c0a5-4a36-8459-99162fd1e55b tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1502 microversion: 2.1 time: 0.487970 May 27 15:16:45.280141 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 111/242] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:44 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1502 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:45.281941 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f701ce77-1f2b-4808-a925-f10e6dcdaba5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:45.283084 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f701ce77-1f2b-4808-a925-f10e6dcdaba5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:45.284112 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f701ce77-1f2b-4808-a925-f10e6dcdaba5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:45.284723 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f701ce77-1f2b-4808-a925-f10e6dcdaba5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:45.296183 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-641c5126-63af-4077-b5b9-9a265dd5bea0 req-2d6feaf8-9ff6-4cd0-8f1e-a243afaf7406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4d29ebf-5c93-4f7c-b372-121a8843600c", "tag": "499011f1-9fc8-4630-a680-e75f00a1b0e3"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:45.313479 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-641c5126-63af-4077-b5b9-9a265dd5bea0 req-2d6feaf8-9ff6-4cd0-8f1e-a243afaf7406 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:45.314053 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-641c5126-63af-4077-b5b9-9a265dd5bea0 req-2d6feaf8-9ff6-4cd0-8f1e-a243afaf7406 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:45.342258 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-641c5126-63af-4077-b5b9-9a265dd5bea0 req-2d6feaf8-9ff6-4cd0-8f1e-a243afaf7406 service nova] Creating event network-changed:499011f1-9fc8-4630-a680-e75f00a1b0e3 for instance c4d29ebf-5c93-4f7c-b372-121a8843600c on hv-cinder-84254 May 27 15:16:45.354313 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-641c5126-63af-4077-b5b9-9a265dd5bea0 req-2d6feaf8-9ff6-4cd0-8f1e-a243afaf7406 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066881 May 27 15:16:45.355216 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 112/243] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:45.534626 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a67c466a-fbf2-4c8f-9c3a-93d6db0c5a3f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:45.535621 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a67c466a-fbf2-4c8f-9c3a-93d6db0c5a3f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:45.546252 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a67c466a-fbf2-4c8f-9c3a-93d6db0c5a3f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:45.546834 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a67c466a-fbf2-4c8f-9c3a-93d6db0c5a3f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:45.548488 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a67c466a-fbf2-4c8f-9c3a-93d6db0c5a3f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:45.550025 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a67c466a-fbf2-4c8f-9c3a-93d6db0c5a3f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:45.682076 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f701ce77-1f2b-4808-a925-f10e6dcdaba5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:45.694907 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f701ce77-1f2b-4808-a925-f10e6dcdaba5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1724 microversion: 2.1 time: 0.463136 May 27 15:16:45.698663 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 132/244] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:45 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1724 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:45.749969 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-0f1ba97b-a3eb-4a82-850c-95f734272bad tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:45.750716 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-0f1ba97b-a3eb-4a82-850c-95f734272bad tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:45.765502 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0f1ba97b-a3eb-4a82-850c-95f734272bad tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:45.767405 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0f1ba97b-a3eb-4a82-850c-95f734272bad tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:45.770876 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0f1ba97b-a3eb-4a82-850c-95f734272bad tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:45.775390 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0f1ba97b-a3eb-4a82-850c-95f734272bad tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:45.990455 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a67c466a-fbf2-4c8f-9c3a-93d6db0c5a3f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:46.005158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a67c466a-fbf2-4c8f-9c3a-93d6db0c5a3f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:46.006934 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a67c466a-fbf2-4c8f-9c3a-93d6db0c5a3f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:46.011809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a67c466a-fbf2-4c8f-9c3a-93d6db0c5a3f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1721 microversion: 2.20 time: 0.493887 May 27 15:16:46.029128 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 113/245] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:16:45 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1721 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:46.053219 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-0f1ba97b-a3eb-4a82-850c-95f734272bad tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:46.062307 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-0f1ba97b-a3eb-4a82-850c-95f734272bad tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.316463 May 27 15:16:46.062917 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 133/246] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:45 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:46.246474 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f86bb2cf-af3c-41a9-a0ca-566ed3c9a140 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:46.247132 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-f86bb2cf-af3c-41a9-a0ca-566ed3c9a140 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:46.253402 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f86bb2cf-af3c-41a9-a0ca-566ed3c9a140 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:46.253852 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f86bb2cf-af3c-41a9-a0ca-566ed3c9a140 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:46.254626 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f86bb2cf-af3c-41a9-a0ca-566ed3c9a140 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:46.255126 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f86bb2cf-af3c-41a9-a0ca-566ed3c9a140 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:46.298596 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ffd96dbc-e8b2-4dcd-bb72-2147356acd3a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:46.299166 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ffd96dbc-e8b2-4dcd-bb72-2147356acd3a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:46.328652 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ffd96dbc-e8b2-4dcd-bb72-2147356acd3a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:46.329279 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ffd96dbc-e8b2-4dcd-bb72-2147356acd3a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:46.330164 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ffd96dbc-e8b2-4dcd-bb72-2147356acd3a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:46.330714 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ffd96dbc-e8b2-4dcd-bb72-2147356acd3a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:46.470315 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f86bb2cf-af3c-41a9-a0ca-566ed3c9a140 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:46.481495 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-f86bb2cf-af3c-41a9-a0ca-566ed3c9a140 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.239682 May 27 15:16:46.482327 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 114/247] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:46 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:46.521734 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-ffd96dbc-e8b2-4dcd-bb72-2147356acd3a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:46.530530 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ffd96dbc-e8b2-4dcd-bb72-2147356acd3a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1502 microversion: 2.1 time: 0.238107 May 27 15:16:46.531228 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 134/248] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:46 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1502 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:46.716583 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-1d84af57-2e7f-42b0-a2ad-2c12cc600dc6 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:46.717235 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-1d84af57-2e7f-42b0-a2ad-2c12cc600dc6 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:46.725518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1d84af57-2e7f-42b0-a2ad-2c12cc600dc6 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:46.725971 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1d84af57-2e7f-42b0-a2ad-2c12cc600dc6 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:46.727392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1d84af57-2e7f-42b0-a2ad-2c12cc600dc6 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:46.728038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1d84af57-2e7f-42b0-a2ad-2c12cc600dc6 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:46.897732 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-1d84af57-2e7f-42b0-a2ad-2c12cc600dc6 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:46.909583 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-1d84af57-2e7f-42b0-a2ad-2c12cc600dc6 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1724 microversion: 2.1 time: 0.197067 May 27 15:16:46.917805 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 115/249] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:46 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:47.030938 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b1bc43eb-2b75-4203-ad55-1ac54b0092a2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:47.032009 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b1bc43eb-2b75-4203-ad55-1ac54b0092a2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:47.045703 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b1bc43eb-2b75-4203-ad55-1ac54b0092a2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:47.046149 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b1bc43eb-2b75-4203-ad55-1ac54b0092a2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:47.046946 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b1bc43eb-2b75-4203-ad55-1ac54b0092a2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:47.047377 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b1bc43eb-2b75-4203-ad55-1ac54b0092a2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:47.062690 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=100 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:47.079585 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-0303abbe-48fc-4f86-8ee8-3e5959f39194 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:47.080195 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-0303abbe-48fc-4f86-8ee8-3e5959f39194 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:47.086931 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0303abbe-48fc-4f86-8ee8-3e5959f39194 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:47.087383 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0303abbe-48fc-4f86-8ee8-3e5959f39194 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:47.088154 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0303abbe-48fc-4f86-8ee8-3e5959f39194 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:47.088607 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0303abbe-48fc-4f86-8ee8-3e5959f39194 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:47.241450 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b1bc43eb-2b75-4203-ad55-1ac54b0092a2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:47.269301 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b1bc43eb-2b75-4203-ad55-1ac54b0092a2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:47.271303 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b1bc43eb-2b75-4203-ad55-1ac54b0092a2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:47.272746 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b1bc43eb-2b75-4203-ad55-1ac54b0092a2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1721 microversion: 2.20 time: 0.246233 May 27 15:16:47.274374 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 135/250] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:16:47 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1721 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:47.287926 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-0303abbe-48fc-4f86-8ee8-3e5959f39194 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:47.295802 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-0303abbe-48fc-4f86-8ee8-3e5959f39194 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.220003 May 27 15:16:47.296464 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 116/251] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:47 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:47.499444 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ee536c72-3a3f-412d-a21c-01689334da31 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:47.500057 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ee536c72-3a3f-412d-a21c-01689334da31 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:47.509101 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ee536c72-3a3f-412d-a21c-01689334da31 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:47.510115 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ee536c72-3a3f-412d-a21c-01689334da31 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:47.511180 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ee536c72-3a3f-412d-a21c-01689334da31 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:47.511888 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ee536c72-3a3f-412d-a21c-01689334da31 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:47.548028 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-aa6bfda2-b664-437d-abe6-4e75b7c6c87c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:47.548643 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-aa6bfda2-b664-437d-abe6-4e75b7c6c87c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:47.555946 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-aa6bfda2-b664-437d-abe6-4e75b7c6c87c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:47.556365 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-aa6bfda2-b664-437d-abe6-4e75b7c6c87c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:47.557141 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-aa6bfda2-b664-437d-abe6-4e75b7c6c87c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:47.557580 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-aa6bfda2-b664-437d-abe6-4e75b7c6c87c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:47.739930 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-ee536c72-3a3f-412d-a21c-01689334da31 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:47.743195 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-aa6bfda2-b664-437d-abe6-4e75b7c6c87c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:47.749553 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ee536c72-3a3f-412d-a21c-01689334da31 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.253914 May 27 15:16:47.750712 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 136/252] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:47 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:47.754385 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-aa6bfda2-b664-437d-abe6-4e75b7c6c87c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1502 microversion: 2.1 time: 0.210067 May 27 15:16:47.765070 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 117/253] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:47 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1502 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:47.928346 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-0a2bbb50-ebbd-4d85-8fa5-3a0468a559ac tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:47.929215 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-0a2bbb50-ebbd-4d85-8fa5-3a0468a559ac tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:47.939991 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0a2bbb50-ebbd-4d85-8fa5-3a0468a559ac tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:47.939991 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0a2bbb50-ebbd-4d85-8fa5-3a0468a559ac tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:47.939991 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0a2bbb50-ebbd-4d85-8fa5-3a0468a559ac tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:47.939991 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0a2bbb50-ebbd-4d85-8fa5-3a0468a559ac tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:48.032261 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=14 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:48.075825 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-0a2bbb50-ebbd-4d85-8fa5-3a0468a559ac tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:48.083800 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-0a2bbb50-ebbd-4d85-8fa5-3a0468a559ac tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1724 microversion: 2.1 time: 0.159335 May 27 15:16:48.084356 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 137/254] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:47 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:48.293749 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-8206b9a0-5c0c-43d1-bddb-fa9299e9f7b1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:48.294798 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-8206b9a0-5c0c-43d1-bddb-fa9299e9f7b1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:48.301367 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8206b9a0-5c0c-43d1-bddb-fa9299e9f7b1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:48.301816 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8206b9a0-5c0c-43d1-bddb-fa9299e9f7b1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:48.302657 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8206b9a0-5c0c-43d1-bddb-fa9299e9f7b1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:48.303124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8206b9a0-5c0c-43d1-bddb-fa9299e9f7b1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:48.313156 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-54f7e1c5-9416-49bb-852c-407e01fbd30e tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:48.313756 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-54f7e1c5-9416-49bb-852c-407e01fbd30e tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:48.320117 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-54f7e1c5-9416-49bb-852c-407e01fbd30e tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:48.321337 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-54f7e1c5-9416-49bb-852c-407e01fbd30e tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:48.322368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-54f7e1c5-9416-49bb-852c-407e01fbd30e tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:48.322804 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-54f7e1c5-9416-49bb-852c-407e01fbd30e tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:48.510765 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-8206b9a0-5c0c-43d1-bddb-fa9299e9f7b1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:48.521069 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-8206b9a0-5c0c-43d1-bddb-fa9299e9f7b1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:48.521585 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-54f7e1c5-9416-49bb-852c-407e01fbd30e tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:48.522632 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-8206b9a0-5c0c-43d1-bddb-fa9299e9f7b1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:48.523833 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-8206b9a0-5c0c-43d1-bddb-fa9299e9f7b1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1721 microversion: 2.20 time: 0.235665 May 27 15:16:48.524396 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 118/255] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:16:48 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:48.531258 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-54f7e1c5-9416-49bb-852c-407e01fbd30e tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.221782 May 27 15:16:48.531868 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 138/256] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:48 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:48.768010 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-ba544f32-ae5d-45da-94b2-75a22178fc56 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:48.768502 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-ba544f32-ae5d-45da-94b2-75a22178fc56 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:48.772317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-203bd374-8449-4a9d-b6d7-ccf592d0b74d tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:48.773005 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-203bd374-8449-4a9d-b6d7-ccf592d0b74d tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:48.776107 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ba544f32-ae5d-45da-94b2-75a22178fc56 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:48.776618 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ba544f32-ae5d-45da-94b2-75a22178fc56 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:48.777434 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ba544f32-ae5d-45da-94b2-75a22178fc56 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:48.777901 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ba544f32-ae5d-45da-94b2-75a22178fc56 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:48.779740 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-203bd374-8449-4a9d-b6d7-ccf592d0b74d tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:48.780181 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-203bd374-8449-4a9d-b6d7-ccf592d0b74d tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:48.780943 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-203bd374-8449-4a9d-b6d7-ccf592d0b74d tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:48.781370 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-203bd374-8449-4a9d-b6d7-ccf592d0b74d tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:48.997833 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-ba544f32-ae5d-45da-94b2-75a22178fc56 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:49.001033 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-203bd374-8449-4a9d-b6d7-ccf592d0b74d tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:49.005869 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-ba544f32-ae5d-45da-94b2-75a22178fc56 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.241792 May 27 15:16:49.006470 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 119/257] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:48 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:49.009146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-203bd374-8449-4a9d-b6d7-ccf592d0b74d tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1502 microversion: 2.1 time: 0.240829 May 27 15:16:49.009800 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 139/258] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:48 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1502 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:49.101442 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d252aed4-eb0c-4f65-94d3-6f6313995d56 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:49.103011 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-d252aed4-eb0c-4f65-94d3-6f6313995d56 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:49.108926 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d252aed4-eb0c-4f65-94d3-6f6313995d56 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:49.109372 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d252aed4-eb0c-4f65-94d3-6f6313995d56 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:49.110120 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d252aed4-eb0c-4f65-94d3-6f6313995d56 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:49.110554 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d252aed4-eb0c-4f65-94d3-6f6313995d56 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:49.241826 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d252aed4-eb0c-4f65-94d3-6f6313995d56 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:49.249911 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-d252aed4-eb0c-4f65-94d3-6f6313995d56 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1724 microversion: 2.1 time: 0.152336 May 27 15:16:49.250513 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 120/259] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:49 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:49.541646 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-4662da80-6421-4794-8ab9-f599e203c74e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:49.542296 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-4662da80-6421-4794-8ab9-f599e203c74e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:49.548451 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4662da80-6421-4794-8ab9-f599e203c74e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:49.548638 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f5f0ea36-e61d-4987-83a8-2dd3c43d1f21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:49.549025 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4662da80-6421-4794-8ab9-f599e203c74e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:49.549244 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-f5f0ea36-e61d-4987-83a8-2dd3c43d1f21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:49.549638 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4662da80-6421-4794-8ab9-f599e203c74e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:49.550069 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4662da80-6421-4794-8ab9-f599e203c74e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:49.555185 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f5f0ea36-e61d-4987-83a8-2dd3c43d1f21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:49.555634 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f5f0ea36-e61d-4987-83a8-2dd3c43d1f21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:49.556405 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f5f0ea36-e61d-4987-83a8-2dd3c43d1f21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:49.556842 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f5f0ea36-e61d-4987-83a8-2dd3c43d1f21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:49.979521 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f5f0ea36-e61d-4987-83a8-2dd3c43d1f21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:49.991649 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-4662da80-6421-4794-8ab9-f599e203c74e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:49.992536 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-f5f0ea36-e61d-4987-83a8-2dd3c43d1f21 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.447606 May 27 15:16:49.993152 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 121/260] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:49 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:50.001622 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-4662da80-6421-4794-8ab9-f599e203c74e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:50.007242 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-4662da80-6421-4794-8ab9-f599e203c74e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:50.008461 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-4662da80-6421-4794-8ab9-f599e203c74e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1721 microversion: 2.20 time: 0.470834 May 27 15:16:50.009255 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 140/261] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:16:49 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1721 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:50.023242 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-1e6c9670-640c-4fec-91a8-138ac1690638 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:50.024126 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-1e6c9670-640c-4fec-91a8-138ac1690638 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:50.028853 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ad224fd5-2fb8-4dbc-b4d7-6354c0b4f157 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:50.029593 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ad224fd5-2fb8-4dbc-b4d7-6354c0b4f157 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:50.031447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1e6c9670-640c-4fec-91a8-138ac1690638 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:50.032067 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1e6c9670-640c-4fec-91a8-138ac1690638 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:50.033009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1e6c9670-640c-4fec-91a8-138ac1690638 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:50.033441 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1e6c9670-640c-4fec-91a8-138ac1690638 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:50.039554 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ad224fd5-2fb8-4dbc-b4d7-6354c0b4f157 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:50.040437 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ad224fd5-2fb8-4dbc-b4d7-6354c0b4f157 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:50.040985 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ad224fd5-2fb8-4dbc-b4d7-6354c0b4f157 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:50.041643 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ad224fd5-2fb8-4dbc-b4d7-6354c0b4f157 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:50.263011 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-1e6c9670-640c-4fec-91a8-138ac1690638 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:50.268773 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-ad224fd5-2fb8-4dbc-b4d7-6354c0b4f157 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:50.272449 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-1e6c9670-640c-4fec-91a8-138ac1690638 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.253528 May 27 15:16:50.282408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 122/262] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:50 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:50.282609 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ad224fd5-2fb8-4dbc-b4d7-6354c0b4f157 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1502 microversion: 2.1 time: 0.256245 May 27 15:16:50.282718 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-caa8f9c8-2c4a-4a2f-841e-39c2b94a6290 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:50.282718 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-caa8f9c8-2c4a-4a2f-841e-39c2b94a6290 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:50.287180 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 141/263] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:50 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1502 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:50.290500 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-caa8f9c8-2c4a-4a2f-841e-39c2b94a6290 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:50.290974 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-caa8f9c8-2c4a-4a2f-841e-39c2b94a6290 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:50.292303 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-caa8f9c8-2c4a-4a2f-841e-39c2b94a6290 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:50.292737 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-caa8f9c8-2c4a-4a2f-841e-39c2b94a6290 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:50.438230 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-caa8f9c8-2c4a-4a2f-841e-39c2b94a6290 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:50.446587 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-caa8f9c8-2c4a-4a2f-841e-39c2b94a6290 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1724 microversion: 2.1 time: 0.172400 May 27 15:16:50.447213 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 123/264] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:50 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:51.009498 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8feccc75-330f-4d6a-9687-288475ecb3bf tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:51.010905 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-8feccc75-330f-4d6a-9687-288475ecb3bf tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:51.017148 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8feccc75-330f-4d6a-9687-288475ecb3bf tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:51.017604 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8feccc75-330f-4d6a-9687-288475ecb3bf tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:51.018368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8feccc75-330f-4d6a-9687-288475ecb3bf tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:51.018804 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8feccc75-330f-4d6a-9687-288475ecb3bf tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:51.028652 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-e46b7ca2-d1df-4285-af1d-837310aea236 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:51.029251 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-e46b7ca2-d1df-4285-af1d-837310aea236 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:51.035651 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e46b7ca2-d1df-4285-af1d-837310aea236 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:51.036235 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e46b7ca2-d1df-4285-af1d-837310aea236 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:51.036999 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e46b7ca2-d1df-4285-af1d-837310aea236 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:51.037504 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e46b7ca2-d1df-4285-af1d-837310aea236 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:51.234229 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-e46b7ca2-d1df-4285-af1d-837310aea236 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:51.237352 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-8feccc75-330f-4d6a-9687-288475ecb3bf tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:51.243731 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-e46b7ca2-d1df-4285-af1d-837310aea236 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:51.245913 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-8feccc75-330f-4d6a-9687-288475ecb3bf tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.240210 May 27 15:16:51.246756 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-e46b7ca2-d1df-4285-af1d-837310aea236 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:51.247042 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 142/265] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:51 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:51.248295 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-e46b7ca2-d1df-4285-af1d-837310aea236 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1742 microversion: 2.20 time: 0.224952 May 27 15:16:51.249011 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 124/266] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:16:51 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1742 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:51.289638 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f34aa7d6-9427-455e-ae06-0b7cbc494052 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:51.290485 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f34aa7d6-9427-455e-ae06-0b7cbc494052 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:51.294111 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-518be3ec-03d6-4876-beab-3bfbe9a49981 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:51.294838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-518be3ec-03d6-4876-beab-3bfbe9a49981 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:51.297276 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f34aa7d6-9427-455e-ae06-0b7cbc494052 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:51.297728 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f34aa7d6-9427-455e-ae06-0b7cbc494052 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:51.298498 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f34aa7d6-9427-455e-ae06-0b7cbc494052 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:51.298955 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f34aa7d6-9427-455e-ae06-0b7cbc494052 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:51.304618 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-518be3ec-03d6-4876-beab-3bfbe9a49981 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:51.305201 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-518be3ec-03d6-4876-beab-3bfbe9a49981 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:51.306390 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-518be3ec-03d6-4876-beab-3bfbe9a49981 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:51.306769 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-518be3ec-03d6-4876-beab-3bfbe9a49981 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:51.333436 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:51.512283 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f34aa7d6-9427-455e-ae06-0b7cbc494052 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:51.515930 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-518be3ec-03d6-4876-beab-3bfbe9a49981 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:51.519820 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f34aa7d6-9427-455e-ae06-0b7cbc494052 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.234083 May 27 15:16:51.520411 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 143/267] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:51 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:51.524771 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ed9e1401-5a7b-4b21-971d-1edeab259014 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:51.525369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ed9e1401-5a7b-4b21-971d-1edeab259014 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:51.529711 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-518be3ec-03d6-4876-beab-3bfbe9a49981 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1502 microversion: 2.1 time: 0.240195 May 27 15:16:51.530488 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 125/268] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:51 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1502 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:51.531284 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ed9e1401-5a7b-4b21-971d-1edeab259014 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:51.531732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ed9e1401-5a7b-4b21-971d-1edeab259014 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:51.532492 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ed9e1401-5a7b-4b21-971d-1edeab259014 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:51.533359 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ed9e1401-5a7b-4b21-971d-1edeab259014 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:51.662233 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-ed9e1401-5a7b-4b21-971d-1edeab259014 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:51.671196 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ed9e1401-5a7b-4b21-971d-1edeab259014 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1724 microversion: 2.1 time: 0.149797 May 27 15:16:51.671778 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 144/269] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:51 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:52.264453 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-26f816cd-e56b-4d93-8c30-3ae96cd7dd12 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:52.265066 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-26f816cd-e56b-4d93-8c30-3ae96cd7dd12 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:52.267129 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-1b8d2a35-f708-476d-9c53-85cf51bd5a4c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:52.267784 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-1b8d2a35-f708-476d-9c53-85cf51bd5a4c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:52.271683 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-26f816cd-e56b-4d93-8c30-3ae96cd7dd12 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:52.272134 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-26f816cd-e56b-4d93-8c30-3ae96cd7dd12 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:52.272906 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-26f816cd-e56b-4d93-8c30-3ae96cd7dd12 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:52.273348 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-26f816cd-e56b-4d93-8c30-3ae96cd7dd12 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:52.273794 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1b8d2a35-f708-476d-9c53-85cf51bd5a4c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:52.274245 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1b8d2a35-f708-476d-9c53-85cf51bd5a4c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:52.275053 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1b8d2a35-f708-476d-9c53-85cf51bd5a4c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:52.275488 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1b8d2a35-f708-476d-9c53-85cf51bd5a4c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:52.468911 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-26f816cd-e56b-4d93-8c30-3ae96cd7dd12 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:52.471823 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-1b8d2a35-f708-476d-9c53-85cf51bd5a4c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:52.476680 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-26f816cd-e56b-4d93-8c30-3ae96cd7dd12 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.216799 May 27 15:16:52.477266 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 126/270] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:52 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:52.480327 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-1b8d2a35-f708-476d-9c53-85cf51bd5a4c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:52.481818 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-1b8d2a35-f708-476d-9c53-85cf51bd5a4c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:52.482995 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-1b8d2a35-f708-476d-9c53-85cf51bd5a4c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1742 microversion: 2.20 time: 0.219745 May 27 15:16:52.483580 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 145/271] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:16:52 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1742 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:16:52.536916 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-6997f7ef-a7b1-4024-ac10-94dd39fd9d13 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:52.537598 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-6997f7ef-a7b1-4024-ac10-94dd39fd9d13 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:52.543971 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6997f7ef-a7b1-4024-ac10-94dd39fd9d13 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:52.544492 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6997f7ef-a7b1-4024-ac10-94dd39fd9d13 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:52.545323 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6997f7ef-a7b1-4024-ac10-94dd39fd9d13 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:52.545828 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6997f7ef-a7b1-4024-ac10-94dd39fd9d13 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:52.547236 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-9aa07b18-ee23-4573-bcfc-e9db89159702 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:52.547849 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-9aa07b18-ee23-4573-bcfc-e9db89159702 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:52.554311 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9aa07b18-ee23-4573-bcfc-e9db89159702 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:52.554759 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9aa07b18-ee23-4573-bcfc-e9db89159702 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:52.555558 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9aa07b18-ee23-4573-bcfc-e9db89159702 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:52.555994 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9aa07b18-ee23-4573-bcfc-e9db89159702 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:52.767168 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-6997f7ef-a7b1-4024-ac10-94dd39fd9d13 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:52.776089 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-6997f7ef-a7b1-4024-ac10-94dd39fd9d13 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.242863 May 27 15:16:52.778431 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-9aa07b18-ee23-4573-bcfc-e9db89159702 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:52.786033 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 127/272] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:52 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:52.791403 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-e0d319e2-6cb9-4371-88c2-4496e6a1b1a7 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:52.792129 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-e0d319e2-6cb9-4371-88c2-4496e6a1b1a7 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:52.798528 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e0d319e2-6cb9-4371-88c2-4496e6a1b1a7 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:52.799181 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e0d319e2-6cb9-4371-88c2-4496e6a1b1a7 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:52.800051 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e0d319e2-6cb9-4371-88c2-4496e6a1b1a7 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:52.800554 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e0d319e2-6cb9-4371-88c2-4496e6a1b1a7 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:52.815663 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-9aa07b18-ee23-4573-bcfc-e9db89159702 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1502 microversion: 2.1 time: 0.272109 May 27 15:16:52.817009 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 146/273] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:52 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1502 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:52.935078 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-e0d319e2-6cb9-4371-88c2-4496e6a1b1a7 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:52.943099 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-e0d319e2-6cb9-4371-88c2-4496e6a1b1a7 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1724 microversion: 2.1 time: 0.155594 May 27 15:16:52.943666 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 128/274] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:52 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:53.493328 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f9fc79c3-df7b-4562-87b2-cbe888252036 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:53.493935 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f9fc79c3-df7b-4562-87b2-cbe888252036 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:53.500366 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f9fc79c3-df7b-4562-87b2-cbe888252036 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:53.500819 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f9fc79c3-df7b-4562-87b2-cbe888252036 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:53.500946 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-ecfd354e-0dbf-4739-bee7-65834442bb8b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:53.501546 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-ecfd354e-0dbf-4739-bee7-65834442bb8b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:53.501646 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f9fc79c3-df7b-4562-87b2-cbe888252036 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:53.502056 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f9fc79c3-df7b-4562-87b2-cbe888252036 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:53.507674 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ecfd354e-0dbf-4739-bee7-65834442bb8b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:53.508118 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ecfd354e-0dbf-4739-bee7-65834442bb8b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:53.508868 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ecfd354e-0dbf-4739-bee7-65834442bb8b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:53.509294 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ecfd354e-0dbf-4739-bee7-65834442bb8b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:53.696457 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f9fc79c3-df7b-4562-87b2-cbe888252036 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:53.704458 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-ecfd354e-0dbf-4739-bee7-65834442bb8b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:53.705475 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f9fc79c3-df7b-4562-87b2-cbe888252036 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.215889 May 27 15:16:53.706053 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 147/275] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:53 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:53.712923 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-ecfd354e-0dbf-4739-bee7-65834442bb8b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:53.715123 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-ecfd354e-0dbf-4739-bee7-65834442bb8b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:53.716527 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-ecfd354e-0dbf-4739-bee7-65834442bb8b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1742 microversion: 2.20 time: 0.219396 May 27 15:16:53.717096 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 129/276] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:16:53 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1742 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:16:53.793124 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-d6a416df-59b0-4b64-bb6c-8c6cd08a285f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:53.794227 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-d6a416df-59b0-4b64-bb6c-8c6cd08a285f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:53.800804 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d6a416df-59b0-4b64-bb6c-8c6cd08a285f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:53.801881 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d6a416df-59b0-4b64-bb6c-8c6cd08a285f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:53.803122 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d6a416df-59b0-4b64-bb6c-8c6cd08a285f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:53.803780 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d6a416df-59b0-4b64-bb6c-8c6cd08a285f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:53.853594 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-e17eeb9f-e730-47c9-80c8-7c6a74e3eb45 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:53.854199 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-e17eeb9f-e730-47c9-80c8-7c6a74e3eb45 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:53.860542 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e17eeb9f-e730-47c9-80c8-7c6a74e3eb45 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:53.861003 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e17eeb9f-e730-47c9-80c8-7c6a74e3eb45 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:53.861763 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e17eeb9f-e730-47c9-80c8-7c6a74e3eb45 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:53.862223 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e17eeb9f-e730-47c9-80c8-7c6a74e3eb45 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:54.061088 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-d6a416df-59b0-4b64-bb6c-8c6cd08a285f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:54.065634 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-e17eeb9f-e730-47c9-80c8-7c6a74e3eb45 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:54.068586 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-d6a416df-59b0-4b64-bb6c-8c6cd08a285f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.279287 May 27 15:16:54.069165 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 148/277] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:53 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:54.074411 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ef7e0dcb-5c87-4b8d-aa04-621b2a914afe tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:54.075041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ef7e0dcb-5c87-4b8d-aa04-621b2a914afe tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:54.075462 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-e17eeb9f-e730-47c9-80c8-7c6a74e3eb45 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1502 microversion: 2.1 time: 0.225562 May 27 15:16:54.076129 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 130/278] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:53 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1502 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:54.082453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ef7e0dcb-5c87-4b8d-aa04-621b2a914afe tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:54.082928 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ef7e0dcb-5c87-4b8d-aa04-621b2a914afe tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:54.083690 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ef7e0dcb-5c87-4b8d-aa04-621b2a914afe tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:54.084154 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ef7e0dcb-5c87-4b8d-aa04-621b2a914afe tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:54.217125 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-ef7e0dcb-5c87-4b8d-aa04-621b2a914afe tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:54.226999 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ef7e0dcb-5c87-4b8d-aa04-621b2a914afe tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1724 microversion: 2.1 time: 0.156780 May 27 15:16:54.227579 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 149/279] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:54 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:54.723395 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a7105905-fd25-4021-b6b9-d26a60665a4b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:54.724040 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a7105905-fd25-4021-b6b9-d26a60665a4b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:54.737531 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a7105905-fd25-4021-b6b9-d26a60665a4b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:54.739065 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a7105905-fd25-4021-b6b9-d26a60665a4b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:54.741128 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-cb69735a-1dbd-4df1-ad66-8537081fc612 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:54.741518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a7105905-fd25-4021-b6b9-d26a60665a4b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:54.741957 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a7105905-fd25-4021-b6b9-d26a60665a4b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:54.742502 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-cb69735a-1dbd-4df1-ad66-8537081fc612 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:54.756123 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-cb69735a-1dbd-4df1-ad66-8537081fc612 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:54.756625 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-cb69735a-1dbd-4df1-ad66-8537081fc612 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:54.758389 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-cb69735a-1dbd-4df1-ad66-8537081fc612 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:54.758871 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-cb69735a-1dbd-4df1-ad66-8537081fc612 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:55.072916 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a7105905-fd25-4021-b6b9-d26a60665a4b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:55.080855 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-cb69735a-1dbd-4df1-ad66-8537081fc612 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:55.081917 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a7105905-fd25-4021-b6b9-d26a60665a4b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.362456 May 27 15:16:55.089220 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-cb69735a-1dbd-4df1-ad66-8537081fc612 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:55.091137 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-cb69735a-1dbd-4df1-ad66-8537081fc612 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:55.091750 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 131/280] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:54 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:55.092323 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-cb69735a-1dbd-4df1-ad66-8537081fc612 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1742 microversion: 2.20 time: 0.360773 May 27 15:16:55.092880 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 150/281] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:16:54 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1742 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:55.097569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e86be54a-0029-4352-92c0-cca36cb8b7fd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:55.098108 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-68d33a3c-3d12-4aab-a9a6-2e9c05c316cd tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:55.098498 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e86be54a-0029-4352-92c0-cca36cb8b7fd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:55.098716 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-68d33a3c-3d12-4aab-a9a6-2e9c05c316cd tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:55.104897 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-68d33a3c-3d12-4aab-a9a6-2e9c05c316cd tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:55.106112 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-68d33a3c-3d12-4aab-a9a6-2e9c05c316cd tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:55.107632 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-68d33a3c-3d12-4aab-a9a6-2e9c05c316cd tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:55.108425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-68d33a3c-3d12-4aab-a9a6-2e9c05c316cd tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:55.108612 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e86be54a-0029-4352-92c0-cca36cb8b7fd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:55.109254 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e86be54a-0029-4352-92c0-cca36cb8b7fd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:55.110031 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e86be54a-0029-4352-92c0-cca36cb8b7fd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:55.110791 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e86be54a-0029-4352-92c0-cca36cb8b7fd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:55.307184 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-e86be54a-0029-4352-92c0-cca36cb8b7fd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:55.320250 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-e86be54a-0029-4352-92c0-cca36cb8b7fd tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1502 microversion: 2.1 time: 0.226078 May 27 15:16:55.329098 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 151/282] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:55 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1502 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:55.329098 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-7af4a658-3d82-4bd3-8bbe-ee0c1b3fc6e3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:55.329098 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-7af4a658-3d82-4bd3-8bbe-ee0c1b3fc6e3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:55.333199 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-68d33a3c-3d12-4aab-a9a6-2e9c05c316cd tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:55.334584 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7af4a658-3d82-4bd3-8bbe-ee0c1b3fc6e3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:55.335138 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7af4a658-3d82-4bd3-8bbe-ee0c1b3fc6e3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:55.336084 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7af4a658-3d82-4bd3-8bbe-ee0c1b3fc6e3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:55.336866 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7af4a658-3d82-4bd3-8bbe-ee0c1b3fc6e3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:55.341231 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-68d33a3c-3d12-4aab-a9a6-2e9c05c316cd tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.247954 May 27 15:16:55.341405 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=100 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:55.342016 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 132/283] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:55 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:55.346711 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-db6cc9f7-7265-4b41-998f-db1eaf885504 req-02b0743c-0efe-448c-9484-2e0f8157e66e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5603ca92-5c6f-416a-b436-8cc9b66079b5", "name": "network-vif-deleted", "tag": "a4f40f1c-633e-47ae-b3fa-ef137d343892"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:55.355691 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-db6cc9f7-7265-4b41-998f-db1eaf885504 req-02b0743c-0efe-448c-9484-2e0f8157e66e service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:55.356111 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-db6cc9f7-7265-4b41-998f-db1eaf885504 req-02b0743c-0efe-448c-9484-2e0f8157e66e service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:55.367582 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-db6cc9f7-7265-4b41-998f-db1eaf885504 req-02b0743c-0efe-448c-9484-2e0f8157e66e service nova] Creating event network-vif-deleted:a4f40f1c-633e-47ae-b3fa-ef137d343892 for instance 5603ca92-5c6f-416a-b436-8cc9b66079b5 on hv-cinder-84254 May 27 15:16:55.373074 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-db6cc9f7-7265-4b41-998f-db1eaf885504 req-02b0743c-0efe-448c-9484-2e0f8157e66e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030115 May 27 15:16:55.373838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 133/284] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:55.474975 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-7af4a658-3d82-4bd3-8bbe-ee0c1b3fc6e3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:55.483361 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-7af4a658-3d82-4bd3-8bbe-ee0c1b3fc6e3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1701 microversion: 2.1 time: 0.160749 May 27 15:16:55.483981 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 152/285] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:55 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1701 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:55.500807 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-84ffad28-2d07-42d4-8a78-415283d24dce tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:55.507791 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-84ffad28-2d07-42d4-8a78-415283d24dce tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:55.508280 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-84ffad28-2d07-42d4-8a78-415283d24dce tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:55.531039 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-84ffad28-2d07-42d4-8a78-415283d24dce tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Going to try to start instance {{(pid=117743) start /opt/stack/nova/nova/compute/api.py:2730}} May 27 15:16:55.575796 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-84ffad28-2d07-42d4-8a78-415283d24dce tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "POST /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27/action" status: 202 len: 0 microversion: 2.1 time: 0.079059 May 27 15:16:55.578989 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 134/286] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 15:16:55 2022] POST /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:16:55.584468 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-aca70a76-4551-47b4-8883-cb5e8662b2d7 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:55.585117 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-aca70a76-4551-47b4-8883-cb5e8662b2d7 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:55.592079 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-aca70a76-4551-47b4-8883-cb5e8662b2d7 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:55.592528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-aca70a76-4551-47b4-8883-cb5e8662b2d7 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:55.593542 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-aca70a76-4551-47b4-8883-cb5e8662b2d7 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:55.593978 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-aca70a76-4551-47b4-8883-cb5e8662b2d7 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:55.727578 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-aca70a76-4551-47b4-8883-cb5e8662b2d7 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:55.736484 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-aca70a76-4551-47b4-8883-cb5e8662b2d7 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1710 microversion: 2.1 time: 0.155787 May 27 15:16:55.737096 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 153/287] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:55 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:56.100574 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-177a5b1e-5461-4d3b-ba6a-7b6838f43b17 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:56.101278 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-177a5b1e-5461-4d3b-ba6a-7b6838f43b17 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:56.109988 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-177a5b1e-5461-4d3b-ba6a-7b6838f43b17 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:56.110578 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-177a5b1e-5461-4d3b-ba6a-7b6838f43b17 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:56.111251 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-d5ea01cc-2433-4f1a-9888-aa06e74454a0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:56.111983 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-177a5b1e-5461-4d3b-ba6a-7b6838f43b17 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:56.112159 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-d5ea01cc-2433-4f1a-9888-aa06e74454a0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:56.112410 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-177a5b1e-5461-4d3b-ba6a-7b6838f43b17 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:56.118077 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d5ea01cc-2433-4f1a-9888-aa06e74454a0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:56.118525 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d5ea01cc-2433-4f1a-9888-aa06e74454a0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:56.119405 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d5ea01cc-2433-4f1a-9888-aa06e74454a0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:56.119841 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d5ea01cc-2433-4f1a-9888-aa06e74454a0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:56.320538 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-177a5b1e-5461-4d3b-ba6a-7b6838f43b17 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:56.327962 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-d5ea01cc-2433-4f1a-9888-aa06e74454a0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:56.328818 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-177a5b1e-5461-4d3b-ba6a-7b6838f43b17 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.233049 May 27 15:16:56.329401 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 135/288] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:56 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:56.336532 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-d5ea01cc-2433-4f1a-9888-aa06e74454a0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:56.337088 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-8e05728d-b7da-4060-803c-bdcec98e6f9a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:56.337751 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-8e05728d-b7da-4060-803c-bdcec98e6f9a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:56.338048 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-d5ea01cc-2433-4f1a-9888-aa06e74454a0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:56.339301 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-d5ea01cc-2433-4f1a-9888-aa06e74454a0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1742 microversion: 2.20 time: 0.232039 May 27 15:16:56.339898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 154/289] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:16:56 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1742 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:16:56.344084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8e05728d-b7da-4060-803c-bdcec98e6f9a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:56.344469 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8e05728d-b7da-4060-803c-bdcec98e6f9a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:56.345219 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8e05728d-b7da-4060-803c-bdcec98e6f9a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:56.345644 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8e05728d-b7da-4060-803c-bdcec98e6f9a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:56.357304 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f44188e0-69a0-4f98-880a-f80c70b549c3 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:56.357942 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f44188e0-69a0-4f98-880a-f80c70b549c3 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:56.363944 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f44188e0-69a0-4f98-880a-f80c70b549c3 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:56.364402 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f44188e0-69a0-4f98-880a-f80c70b549c3 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:56.365158 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f44188e0-69a0-4f98-880a-f80c70b549c3 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:56.365595 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f44188e0-69a0-4f98-880a-f80c70b549c3 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:56.412795 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-8e05728d-b7da-4060-803c-bdcec98e6f9a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:56.420771 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-8e05728d-b7da-4060-803c-bdcec98e6f9a tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1460 microversion: 2.1 time: 0.087272 May 27 15:16:56.421356 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 136/290] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:56 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1460 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:56.505519 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f44188e0-69a0-4f98-880a-f80c70b549c3 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:56.513849 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f44188e0-69a0-4f98-880a-f80c70b549c3 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.160354 May 27 15:16:56.514416 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 155/291] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:56 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:16:56.756068 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d5a0dcd1-7da2-42b3-a6b5-3578c17e029f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:56.756068 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-d5a0dcd1-7da2-42b3-a6b5-3578c17e029f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:56.762225 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d5a0dcd1-7da2-42b3-a6b5-3578c17e029f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:56.762686 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d5a0dcd1-7da2-42b3-a6b5-3578c17e029f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:56.763497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d5a0dcd1-7da2-42b3-a6b5-3578c17e029f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:56.763938 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d5a0dcd1-7da2-42b3-a6b5-3578c17e029f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:56.895208 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d5a0dcd1-7da2-42b3-a6b5-3578c17e029f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:56.903709 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-d5a0dcd1-7da2-42b3-a6b5-3578c17e029f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1710 microversion: 2.1 time: 0.153821 May 27 15:16:56.904387 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 137/292] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:56 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1710 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:57.345446 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-02ba8135-e1e9-4144-a078-f97ddc4377b8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:57.346064 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-02ba8135-e1e9-4144-a078-f97ddc4377b8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:57.352258 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-02ba8135-e1e9-4144-a078-f97ddc4377b8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:57.352699 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-02ba8135-e1e9-4144-a078-f97ddc4377b8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:57.353466 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-02ba8135-e1e9-4144-a078-f97ddc4377b8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:57.353892 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-02ba8135-e1e9-4144-a078-f97ddc4377b8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:57.358237 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-e452f56e-6742-45b1-a73e-06d31158e62b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:57.358984 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-e452f56e-6742-45b1-a73e-06d31158e62b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:57.365524 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e452f56e-6742-45b1-a73e-06d31158e62b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:57.365961 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e452f56e-6742-45b1-a73e-06d31158e62b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:57.366732 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e452f56e-6742-45b1-a73e-06d31158e62b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:57.367189 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e452f56e-6742-45b1-a73e-06d31158e62b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:57.567418 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-02ba8135-e1e9-4144-a078-f97ddc4377b8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:57.571796 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-e452f56e-6742-45b1-a73e-06d31158e62b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:57.576315 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-02ba8135-e1e9-4144-a078-f97ddc4377b8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.234799 May 27 15:16:57.576811 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 156/293] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:57 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:57.581660 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-e452f56e-6742-45b1-a73e-06d31158e62b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:57.582278 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-a048a650-6114-468c-95c3-c3b74967cc8c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:57.582907 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-a048a650-6114-468c-95c3-c3b74967cc8c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:57.584171 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-e452f56e-6742-45b1-a73e-06d31158e62b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:57.585711 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-e452f56e-6742-45b1-a73e-06d31158e62b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1742 microversion: 2.20 time: 0.231889 May 27 15:16:57.586485 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 138/294] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:16:57 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1742 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:16:57.590055 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a048a650-6114-468c-95c3-c3b74967cc8c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:57.590604 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a048a650-6114-468c-95c3-c3b74967cc8c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:57.591410 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a048a650-6114-468c-95c3-c3b74967cc8c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:57.591843 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a048a650-6114-468c-95c3-c3b74967cc8c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:57.593588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9df94098-80c2-4dd4-96a0-e374f77d1091 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:57.594592 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9df94098-80c2-4dd4-96a0-e374f77d1091 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:57.601304 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9df94098-80c2-4dd4-96a0-e374f77d1091 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:57.601951 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9df94098-80c2-4dd4-96a0-e374f77d1091 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:57.602711 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9df94098-80c2-4dd4-96a0-e374f77d1091 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:57.603437 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9df94098-80c2-4dd4-96a0-e374f77d1091 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:57.674154 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-a048a650-6114-468c-95c3-c3b74967cc8c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:57.681591 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-a048a650-6114-468c-95c3-c3b74967cc8c tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1460 microversion: 2.1 time: 0.103836 May 27 15:16:57.682157 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 157/295] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:57 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1460 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:57.753872 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9df94098-80c2-4dd4-96a0-e374f77d1091 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:57.761887 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9df94098-80c2-4dd4-96a0-e374f77d1091 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.174208 May 27 15:16:57.762515 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 139/296] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:57 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:57.922689 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-59919147-be01-453f-b598-41fa4823afdd tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:57.922689 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-59919147-be01-453f-b598-41fa4823afdd tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:57.931327 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-59919147-be01-453f-b598-41fa4823afdd tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:57.932000 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-59919147-be01-453f-b598-41fa4823afdd tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:57.933650 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-59919147-be01-453f-b598-41fa4823afdd tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:57.934304 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-59919147-be01-453f-b598-41fa4823afdd tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:58.069693 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-59919147-be01-453f-b598-41fa4823afdd tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:58.078249 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-59919147-be01-453f-b598-41fa4823afdd tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1710 microversion: 2.1 time: 0.160884 May 27 15:16:58.078821 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 158/297] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:57 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1710 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:58.594326 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-6bf31ada-e182-487e-83ed-1c5434960785 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:58.595000 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-6bf31ada-e182-487e-83ed-1c5434960785 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:58.601528 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6bf31ada-e182-487e-83ed-1c5434960785 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:58.601975 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6bf31ada-e182-487e-83ed-1c5434960785 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:58.602744 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6bf31ada-e182-487e-83ed-1c5434960785 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:58.603206 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6bf31ada-e182-487e-83ed-1c5434960785 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:58.606073 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-6d7f6dbc-5cfe-4478-a965-8ad3ceff3fdb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:58.606669 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-6d7f6dbc-5cfe-4478-a965-8ad3ceff3fdb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:58.612717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6d7f6dbc-5cfe-4478-a965-8ad3ceff3fdb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:58.613037 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6d7f6dbc-5cfe-4478-a965-8ad3ceff3fdb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:58.613787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6d7f6dbc-5cfe-4478-a965-8ad3ceff3fdb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:58.614214 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6d7f6dbc-5cfe-4478-a965-8ad3ceff3fdb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:58.803509 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-6bf31ada-e182-487e-83ed-1c5434960785 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:58.807224 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6d7f6dbc-5cfe-4478-a965-8ad3ceff3fdb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:58.811727 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-6bf31ada-e182-487e-83ed-1c5434960785 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.221809 May 27 15:16:58.812309 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 140/298] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:58 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:58.815653 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6d7f6dbc-5cfe-4478-a965-8ad3ceff3fdb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:58.816779 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-8f5ff948-dc96-4b42-a7a4-a5bbb163307f tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:58.817271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6d7f6dbc-5cfe-4478-a965-8ad3ceff3fdb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:58.817409 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-8f5ff948-dc96-4b42-a7a4-a5bbb163307f tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:58.819302 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-6d7f6dbc-5cfe-4478-a965-8ad3ceff3fdb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1742 microversion: 2.20 time: 0.217731 May 27 15:16:58.820789 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 159/299] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:16:58 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1742 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:16:58.823652 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8f5ff948-dc96-4b42-a7a4-a5bbb163307f tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:58.824103 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8f5ff948-dc96-4b42-a7a4-a5bbb163307f tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:58.824927 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8f5ff948-dc96-4b42-a7a4-a5bbb163307f tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:58.825361 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8f5ff948-dc96-4b42-a7a4-a5bbb163307f tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:58.825465 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-c2074278-f6f9-4d4e-98f9-f8a5dc716c90 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:58.826020 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-c2074278-f6f9-4d4e-98f9-f8a5dc716c90 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:58.834031 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c2074278-f6f9-4d4e-98f9-f8a5dc716c90 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:58.834434 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c2074278-f6f9-4d4e-98f9-f8a5dc716c90 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:58.835163 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c2074278-f6f9-4d4e-98f9-f8a5dc716c90 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:58.835595 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c2074278-f6f9-4d4e-98f9-f8a5dc716c90 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:58.895045 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-8f5ff948-dc96-4b42-a7a4-a5bbb163307f tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:58.897385 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:16:58.905203 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-8f5ff948-dc96-4b42-a7a4-a5bbb163307f tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1460 microversion: 2.1 time: 0.091889 May 27 15:16:58.905785 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 141/300] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:58 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1460 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:58.992990 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-c2074278-f6f9-4d4e-98f9-f8a5dc716c90 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:59.006752 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-c2074278-f6f9-4d4e-98f9-f8a5dc716c90 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.184767 May 27 15:16:59.007408 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 160/301] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:58 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:59.099301 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9bd63067-6454-4a1b-8609-75bdd2c3d36c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:59.100208 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9bd63067-6454-4a1b-8609-75bdd2c3d36c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:59.117843 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9bd63067-6454-4a1b-8609-75bdd2c3d36c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:59.119026 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9bd63067-6454-4a1b-8609-75bdd2c3d36c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:59.120280 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9bd63067-6454-4a1b-8609-75bdd2c3d36c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:59.120876 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9bd63067-6454-4a1b-8609-75bdd2c3d36c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:59.221095 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-3b46fa44-fef3-4b19-8d1b-73d4695bae76 req-c8d1fae4-9881-4aa7-b023-a1fa72717004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88bbd4b-d173-4df5-9e19-4fedb81b4aed", "name": "network-vif-plugged", "status": "completed", "tag": "b65a7130-71a7-4267-9201-c07ec8e83b00"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:16:59.279325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-3b46fa44-fef3-4b19-8d1b-73d4695bae76 req-c8d1fae4-9881-4aa7-b023-a1fa72717004 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:59.281917 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-3b46fa44-fef3-4b19-8d1b-73d4695bae76 req-c8d1fae4-9881-4aa7-b023-a1fa72717004 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:59.307450 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-3b46fa44-fef3-4b19-8d1b-73d4695bae76 req-c8d1fae4-9881-4aa7-b023-a1fa72717004 service nova] Creating event network-vif-plugged:b65a7130-71a7-4267-9201-c07ec8e83b00 for instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed on hv-cinder-84254 May 27 15:16:59.321293 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-3b46fa44-fef3-4b19-8d1b-73d4695bae76 req-c8d1fae4-9881-4aa7-b023-a1fa72717004 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109144 May 27 15:16:59.321919 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 161/302] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:16:59.377861 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9bd63067-6454-4a1b-8609-75bdd2c3d36c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:16:59.386875 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9bd63067-6454-4a1b-8609-75bdd2c3d36c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1710 microversion: 2.1 time: 0.293748 May 27 15:16:59.387787 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 142/303] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:59 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1710 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:16:59.830320 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e371a005-051d-460e-87ff-10cbcbeb3d2a tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:59.833312 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e371a005-051d-460e-87ff-10cbcbeb3d2a tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:59.839348 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9a71a7a2-1a9b-4373-a10c-36014d13b8ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:16:59.839920 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9a71a7a2-1a9b-4373-a10c-36014d13b8ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:16:59.843863 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e371a005-051d-460e-87ff-10cbcbeb3d2a tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:59.845564 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e371a005-051d-460e-87ff-10cbcbeb3d2a tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:59.847895 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e371a005-051d-460e-87ff-10cbcbeb3d2a tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:59.849362 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e371a005-051d-460e-87ff-10cbcbeb3d2a tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:59.859876 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9a71a7a2-1a9b-4373-a10c-36014d13b8ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:59.860895 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9a71a7a2-1a9b-4373-a10c-36014d13b8ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:16:59.861910 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9a71a7a2-1a9b-4373-a10c-36014d13b8ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:16:59.862550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9a71a7a2-1a9b-4373-a10c-36014d13b8ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:00.130074 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-e371a005-051d-460e-87ff-10cbcbeb3d2a tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:00.133052 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9a71a7a2-1a9b-4373-a10c-36014d13b8ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:00.137889 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-e371a005-051d-460e-87ff-10cbcbeb3d2a tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.313262 May 27 15:17:00.138472 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 162/304] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:16:59 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:00.142275 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9a71a7a2-1a9b-4373-a10c-36014d13b8ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:00.143234 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-05eda01d-4e91-47ba-a4b5-ffa8ed3a0b32 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:00.143836 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9a71a7a2-1a9b-4373-a10c-36014d13b8ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:00.143965 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-05eda01d-4e91-47ba-a4b5-ffa8ed3a0b32 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:00.145037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9a71a7a2-1a9b-4373-a10c-36014d13b8ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1737 microversion: 2.20 time: 0.310884 May 27 15:17:00.145729 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 143/305] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:16:59 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1737 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:17:00.150174 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-938b34ba-a172-4b46-9676-00bc448371c8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:00.150784 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-938b34ba-a172-4b46-9676-00bc448371c8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:00.151072 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-05eda01d-4e91-47ba-a4b5-ffa8ed3a0b32 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:00.152257 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-05eda01d-4e91-47ba-a4b5-ffa8ed3a0b32 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:00.153477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-05eda01d-4e91-47ba-a4b5-ffa8ed3a0b32 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:00.154769 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-05eda01d-4e91-47ba-a4b5-ffa8ed3a0b32 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:00.157652 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-938b34ba-a172-4b46-9676-00bc448371c8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:00.158104 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-938b34ba-a172-4b46-9676-00bc448371c8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:00.158898 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-938b34ba-a172-4b46-9676-00bc448371c8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:00.159499 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-938b34ba-a172-4b46-9676-00bc448371c8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:00.189482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-05eda01d-4e91-47ba-a4b5-ffa8ed3a0b32 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:00.189920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-05eda01d-4e91-47ba-a4b5-ffa8ed3a0b32 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:00.190365 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.objects.instance [None req-05eda01d-4e91-47ba-a4b5-ffa8ed3a0b32 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lazy-loading 'fault' on Instance uuid 5603ca92-5c6f-416a-b436-8cc9b66079b5 {{(pid=117742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:17:00.258350 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-05eda01d-4e91-47ba-a4b5-ffa8ed3a0b32 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ac2a8ad2e343838f8e3e3285ec5f55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a48e1060474f21aacf525d26371675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:00.266168 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-05eda01d-4e91-47ba-a4b5-ffa8ed3a0b32 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 200 len: 1303 microversion: 2.1 time: 0.126707 May 27 15:17:00.266789 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 163/306] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:00 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 1303 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:00.321570 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-938b34ba-a172-4b46-9676-00bc448371c8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:00.330507 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-938b34ba-a172-4b46-9676-00bc448371c8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.183946 May 27 15:17:00.331107 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 144/307] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:00 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:00.405344 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b94619e0-2778-4d8b-bb10-ec6d836c992d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:00.405944 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b94619e0-2778-4d8b-bb10-ec6d836c992d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:00.412207 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b94619e0-2778-4d8b-bb10-ec6d836c992d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:00.412684 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b94619e0-2778-4d8b-bb10-ec6d836c992d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:00.413429 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b94619e0-2778-4d8b-bb10-ec6d836c992d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:00.413853 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b94619e0-2778-4d8b-bb10-ec6d836c992d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:00.545836 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b94619e0-2778-4d8b-bb10-ec6d836c992d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:00.553746 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b94619e0-2778-4d8b-bb10-ec6d836c992d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1710 microversion: 2.1 time: 0.153372 May 27 15:17:00.554301 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 164/308] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:00 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1710 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:01.164330 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-4d7b6e1d-c1d1-45c5-83ca-c977bc5744d6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:01.165979 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-821b5f6c-cdb6-4b4f-a36a-2ffadb661e30 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:01.167642 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-821b5f6c-cdb6-4b4f-a36a-2ffadb661e30 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:01.167910 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-4d7b6e1d-c1d1-45c5-83ca-c977bc5744d6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:01.187213 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-821b5f6c-cdb6-4b4f-a36a-2ffadb661e30 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:01.189322 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4d7b6e1d-c1d1-45c5-83ca-c977bc5744d6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:01.190289 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4d7b6e1d-c1d1-45c5-83ca-c977bc5744d6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:01.191445 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4d7b6e1d-c1d1-45c5-83ca-c977bc5744d6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:01.192202 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-821b5f6c-cdb6-4b4f-a36a-2ffadb661e30 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:01.193912 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-821b5f6c-cdb6-4b4f-a36a-2ffadb661e30 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:01.196418 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4d7b6e1d-c1d1-45c5-83ca-c977bc5744d6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:01.197329 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-821b5f6c-cdb6-4b4f-a36a-2ffadb661e30 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:01.459244 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-4d7b6e1d-c1d1-45c5-83ca-c977bc5744d6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:01.465688 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-821b5f6c-cdb6-4b4f-a36a-2ffadb661e30 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:01.467783 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-4d7b6e1d-c1d1-45c5-83ca-c977bc5744d6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:01.469528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-4d7b6e1d-c1d1-45c5-83ca-c977bc5744d6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:01.470676 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-4d7b6e1d-c1d1-45c5-83ca-c977bc5744d6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1737 microversion: 2.20 time: 0.310928 May 27 15:17:01.471263 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 165/309] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:01 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1737 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:01.473449 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-821b5f6c-cdb6-4b4f-a36a-2ffadb661e30 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.321421 May 27 15:17:01.474008 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 145/310] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:01 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:01.475848 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ad47769c-c873-4dfa-a8bd-448bc8f0fb26 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:01.476495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ad47769c-c873-4dfa-a8bd-448bc8f0fb26 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] [instance: 5603ca92-5c6f-416a-b436-8cc9b66079b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:01.479160 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a9be335b-05bd-4b82-b403-411eefb40b28 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:01.480472 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a9be335b-05bd-4b82-b403-411eefb40b28 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:01.483513 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ad47769c-c873-4dfa-a8bd-448bc8f0fb26 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:01.483958 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ad47769c-c873-4dfa-a8bd-448bc8f0fb26 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:01.484719 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ad47769c-c873-4dfa-a8bd-448bc8f0fb26 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:01.485144 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ad47769c-c873-4dfa-a8bd-448bc8f0fb26 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:01.486490 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a9be335b-05bd-4b82-b403-411eefb40b28 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:01.486986 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a9be335b-05bd-4b82-b403-411eefb40b28 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:01.487759 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a9be335b-05bd-4b82-b403-411eefb40b28 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:01.488198 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a9be335b-05bd-4b82-b403-411eefb40b28 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:01.499155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-ad47769c-c873-4dfa-a8bd-448bc8f0fb26 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] HTTP exception thrown: Instance 5603ca92-5c6f-416a-b436-8cc9b66079b5 could not be found. May 27 15:17:01.500787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ad47769c-c873-4dfa-a8bd-448bc8f0fb26 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Request method failure captured: May 27 15:17:01.500787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 HTTP/1.1 May 27 15:17:01.500787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:17:01.500787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:17:01.500787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:17:01.500787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:17:01.500787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:17:01.500787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:17:01.500787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:17:01.500787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:17:01.500787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOsg4ExFMn1KJDNFrOcp86dq2tqwWT7Mg2EmKTpkN7GCSsu8nQgukkJnngLJuqupt_k0-gX-z2Zs9jphf6kHKXR9w4WD4vuuYa3A6dn9YVvyhOzeqUlkkfN2_8JxewxDhe-kUi0axX5_96ruxz7hob1U5MiJxrGoSqIudXlXJY38Z44 May 27 15:17:01.500787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:17:01.500787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:17:01.500787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:17:01.500787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:17:01.500787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:17:01.500787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:17:01.500787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: a5a48e1060474f21aacf525d26371675 May 27 15:17:01.500787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-VolumesActionsTest-1104142404 May 27 15:17:01.500787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:17:01.500787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:17:01.502261 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a5a48e1060474f21aacf525d26371675"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a5a48e1060474f21aacf525d26371675"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a5a48e1060474f21aacf525d26371675"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a5a48e1060474f21aacf525d26371675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:17:01.502261 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-VolumesActionsTest-1104142404 May 27 15:17:01.502261 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: a5a48e1060474f21aacf525d26371675 May 27 15:17:01.502261 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-VolumesActionsTest-1104142404 May 27 15:17:01.502261 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-VolumesActionsTest-1104142404-project May 27 15:17:01.502261 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:17:01.502261 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:17:01.502261 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 34ac2a8ad2e343838f8e3e3285ec5f55 May 27 15:17:01.502261 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-VolumesActionsTest-1104142404-project May 27 15:17:01.502261 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:17:01.502261 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance 5603ca92-5c6f-416a-b436-8cc9b66079b5 could not be found. May 27 15:17:01.502261 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': '5603ca92-5c6f-416a-b436-8cc9b66079b5'} May 27 15:17:01.503199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:17:01.503199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:01.503199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:17:01.503199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:17:01.503199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:17:01.503199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:17:01.503199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:17:01.503199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:17:01.503199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:17:01.503199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:17:01.503199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5603ca92-5c6f-416a-b436-8cc9b66079b5 could not be found. May 27 15:17:01.503199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:17:01.503199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:01.503199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:17:01.503199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:01.503199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:01.503199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:01.503199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:17:01.503199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:17:01.503199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:17:01.504781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:17:01.504781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:17:01.504781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:17:01.504781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:17:01.504781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:17:01.504781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:17:01.504781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:17:01.504781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5603ca92-5c6f-416a-b436-8cc9b66079b5 could not be found. May 27 15:17:01.504781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:17:01.504781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:01.504781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:17:01.504781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:01.504781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:01.504781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:01.504781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:17:01.504781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:17:01.504781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5603ca92-5c6f-416a-b436-8cc9b66079b5 could not be found. May 27 15:17:01.504781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:17:01.505885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ad47769c-c873-4dfa-a8bd-448bc8f0fb26 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] Returning 404 to user: Instance 5603ca92-5c6f-416a-b436-8cc9b66079b5 could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:17:01.505885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ad47769c-c873-4dfa-a8bd-448bc8f0fb26 tempest-VolumesActionsTest-1104142404 tempest-VolumesActionsTest-1104142404-project] 10.222.0.50 "GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5" status: 404 len: 111 microversion: 2.1 time: 0.029979 May 27 15:17:01.505885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 166/311] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:01 2022] GET /compute/v2.1/servers/5603ca92-5c6f-416a-b436-8cc9b66079b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:17:01.569945 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e3976b37-a358-4a5c-9e5c-c82bf2380cb1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:01.571128 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e3976b37-a358-4a5c-9e5c-c82bf2380cb1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:01.577015 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e3976b37-a358-4a5c-9e5c-c82bf2380cb1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:01.577506 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e3976b37-a358-4a5c-9e5c-c82bf2380cb1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:01.578328 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e3976b37-a358-4a5c-9e5c-c82bf2380cb1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:01.578899 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e3976b37-a358-4a5c-9e5c-c82bf2380cb1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:01.900081 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a9be335b-05bd-4b82-b403-411eefb40b28 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:01.908896 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a9be335b-05bd-4b82-b403-411eefb40b28 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.433502 May 27 15:17:01.918885 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 146/312] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:01 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:01.969598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-e3976b37-a358-4a5c-9e5c-c82bf2380cb1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:01.978292 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-e3976b37-a358-4a5c-9e5c-c82bf2380cb1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1710 microversion: 2.1 time: 0.412318 May 27 15:17:01.978880 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 167/313] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:01 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1710 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:02.490744 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d65f32a9-ed53-46af-9709-4adb332a2a3f tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:02.491336 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-d65f32a9-ed53-46af-9709-4adb332a2a3f tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:02.491576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-55069c04-0d20-4237-98ee-c7806c1cd0e0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:02.492377 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-55069c04-0d20-4237-98ee-c7806c1cd0e0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:02.502528 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d65f32a9-ed53-46af-9709-4adb332a2a3f tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:02.503557 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d65f32a9-ed53-46af-9709-4adb332a2a3f tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:02.503827 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-55069c04-0d20-4237-98ee-c7806c1cd0e0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:02.506307 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-55069c04-0d20-4237-98ee-c7806c1cd0e0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:02.507133 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d65f32a9-ed53-46af-9709-4adb332a2a3f tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:02.508538 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-55069c04-0d20-4237-98ee-c7806c1cd0e0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:02.509008 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d65f32a9-ed53-46af-9709-4adb332a2a3f tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:02.511834 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-55069c04-0d20-4237-98ee-c7806c1cd0e0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:02.814761 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-55069c04-0d20-4237-98ee-c7806c1cd0e0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:02.822872 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d65f32a9-ed53-46af-9709-4adb332a2a3f tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:02.824177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-55069c04-0d20-4237-98ee-c7806c1cd0e0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:02.826289 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-55069c04-0d20-4237-98ee-c7806c1cd0e0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:02.828209 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-55069c04-0d20-4237-98ee-c7806c1cd0e0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1737 microversion: 2.20 time: 0.341300 May 27 15:17:02.829437 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 168/314] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:02 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1737 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:02.830743 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-d65f32a9-ed53-46af-9709-4adb332a2a3f tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.344023 May 27 15:17:02.837196 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 147/315] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:02 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:02.926492 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-77aa26ed-e152-4b47-9b83-a28fea289d44 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:02.927915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-77aa26ed-e152-4b47-9b83-a28fea289d44 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:02.935213 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-77aa26ed-e152-4b47-9b83-a28fea289d44 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:02.935985 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-77aa26ed-e152-4b47-9b83-a28fea289d44 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:02.936855 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-77aa26ed-e152-4b47-9b83-a28fea289d44 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:02.937372 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-77aa26ed-e152-4b47-9b83-a28fea289d44 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:03.021862 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b1e4cd38-b9ee-4fbe-a040-87849e49bb6a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:03.023226 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b1e4cd38-b9ee-4fbe-a040-87849e49bb6a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:03.031969 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b1e4cd38-b9ee-4fbe-a040-87849e49bb6a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:03.039645 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b1e4cd38-b9ee-4fbe-a040-87849e49bb6a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:03.040718 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b1e4cd38-b9ee-4fbe-a040-87849e49bb6a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:03.041304 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b1e4cd38-b9ee-4fbe-a040-87849e49bb6a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:03.231150 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-77aa26ed-e152-4b47-9b83-a28fea289d44 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:03.233943 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=100 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:03.244007 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-77aa26ed-e152-4b47-9b83-a28fea289d44 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.321095 May 27 15:17:03.246243 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 169/316] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:02 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:03.268943 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b1e4cd38-b9ee-4fbe-a040-87849e49bb6a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:03.277836 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b1e4cd38-b9ee-4fbe-a040-87849e49bb6a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1710 microversion: 2.1 time: 0.274956 May 27 15:17:03.289025 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 148/317] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:03 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1710 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:03.847986 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a0a170e7-e0dd-42f5-82e6-f0b856d67bd2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:03.849256 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f4502653-c4d9-4069-b4c6-d460eba8fe63 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:03.850395 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f4502653-c4d9-4069-b4c6-d460eba8fe63 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:03.850673 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a0a170e7-e0dd-42f5-82e6-f0b856d67bd2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:03.858769 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f4502653-c4d9-4069-b4c6-d460eba8fe63 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:03.859567 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f4502653-c4d9-4069-b4c6-d460eba8fe63 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:03.859787 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a0a170e7-e0dd-42f5-82e6-f0b856d67bd2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:03.860428 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a0a170e7-e0dd-42f5-82e6-f0b856d67bd2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:03.860988 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f4502653-c4d9-4069-b4c6-d460eba8fe63 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:03.861199 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a0a170e7-e0dd-42f5-82e6-f0b856d67bd2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:03.861805 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a0a170e7-e0dd-42f5-82e6-f0b856d67bd2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:03.861925 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f4502653-c4d9-4069-b4c6-d460eba8fe63 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:04.095572 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f4502653-c4d9-4069-b4c6-d460eba8fe63 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:04.102866 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a0a170e7-e0dd-42f5-82e6-f0b856d67bd2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:04.114557 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a0a170e7-e0dd-42f5-82e6-f0b856d67bd2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:04.118024 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f4502653-c4d9-4069-b4c6-d460eba8fe63 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.273770 May 27 15:17:04.130591 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 170/318] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:03 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:04.132802 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a0a170e7-e0dd-42f5-82e6-f0b856d67bd2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:04.134209 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a0a170e7-e0dd-42f5-82e6-f0b856d67bd2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1737 microversion: 2.20 time: 0.290247 May 27 15:17:04.134762 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 149/319] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:03 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1737 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:04.263449 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-be83487c-2af1-458c-9a00-1cc4eca14a5a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:04.264446 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-be83487c-2af1-458c-9a00-1cc4eca14a5a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:04.274994 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-be83487c-2af1-458c-9a00-1cc4eca14a5a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:04.275576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-be83487c-2af1-458c-9a00-1cc4eca14a5a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:04.276643 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-be83487c-2af1-458c-9a00-1cc4eca14a5a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:04.277141 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-be83487c-2af1-458c-9a00-1cc4eca14a5a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:04.297095 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-1bdd4d14-af87-425c-80e6-9ed058d56893 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:04.298049 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-1bdd4d14-af87-425c-80e6-9ed058d56893 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:04.311758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1bdd4d14-af87-425c-80e6-9ed058d56893 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:04.326697 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1bdd4d14-af87-425c-80e6-9ed058d56893 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:04.328161 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1bdd4d14-af87-425c-80e6-9ed058d56893 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:04.329901 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1bdd4d14-af87-425c-80e6-9ed058d56893 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:04.474338 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-be83487c-2af1-458c-9a00-1cc4eca14a5a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:04.483417 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-be83487c-2af1-458c-9a00-1cc4eca14a5a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.224023 May 27 15:17:04.494677 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 171/320] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:04 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:04.556468 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-1bdd4d14-af87-425c-80e6-9ed058d56893 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:04.565632 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-1bdd4d14-af87-425c-80e6-9ed058d56893 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1710 microversion: 2.1 time: 0.272362 May 27 15:17:04.566207 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 150/321] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:04 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1710 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:05.138390 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-54640dea-758d-4808-8120-ee761c940780 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:05.139047 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-54640dea-758d-4808-8120-ee761c940780 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:05.145655 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-54640dea-758d-4808-8120-ee761c940780 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:05.146103 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-54640dea-758d-4808-8120-ee761c940780 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:05.166946 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f5c42ecd-66bf-44f0-8f78-081b8d50b395 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:05.167811 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-f5c42ecd-66bf-44f0-8f78-081b8d50b395 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:05.172656 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-54640dea-758d-4808-8120-ee761c940780 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:05.173474 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-54640dea-758d-4808-8120-ee761c940780 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:05.177273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f5c42ecd-66bf-44f0-8f78-081b8d50b395 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:05.181112 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f5c42ecd-66bf-44f0-8f78-081b8d50b395 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:05.182081 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f5c42ecd-66bf-44f0-8f78-081b8d50b395 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:05.182581 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f5c42ecd-66bf-44f0-8f78-081b8d50b395 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:05.420459 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f5c42ecd-66bf-44f0-8f78-081b8d50b395 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:05.423407 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-54640dea-758d-4808-8120-ee761c940780 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:05.434997 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-54640dea-758d-4808-8120-ee761c940780 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.301220 May 27 15:17:05.438806 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 172/322] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:05 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:05.442100 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f5c42ecd-66bf-44f0-8f78-081b8d50b395 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:05.443896 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f5c42ecd-66bf-44f0-8f78-081b8d50b395 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:05.445088 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-f5c42ecd-66bf-44f0-8f78-081b8d50b395 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1737 microversion: 2.20 time: 0.290644 May 27 15:17:05.445659 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 151/323] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:05 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1737 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:05.502543 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e69bc395-8805-44f4-83b4-a6c005182431 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:05.503194 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e69bc395-8805-44f4-83b4-a6c005182431 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:05.509617 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e69bc395-8805-44f4-83b4-a6c005182431 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:05.510063 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e69bc395-8805-44f4-83b4-a6c005182431 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:05.511549 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e69bc395-8805-44f4-83b4-a6c005182431 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:05.511991 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e69bc395-8805-44f4-83b4-a6c005182431 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:05.587064 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-e37de021-c732-43d7-977d-c25060086e24 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:05.588352 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-e37de021-c732-43d7-977d-c25060086e24 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:05.596674 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e37de021-c732-43d7-977d-c25060086e24 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:05.597479 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e37de021-c732-43d7-977d-c25060086e24 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:05.598475 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e37de021-c732-43d7-977d-c25060086e24 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:05.598944 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e37de021-c732-43d7-977d-c25060086e24 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:05.743975 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-e69bc395-8805-44f4-83b4-a6c005182431 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:05.753935 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-e69bc395-8805-44f4-83b4-a6c005182431 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.255336 May 27 15:17:05.765299 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 173/324] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:05 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:05.789730 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-e37de021-c732-43d7-977d-c25060086e24 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:05.803599 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-e37de021-c732-43d7-977d-c25060086e24 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1710 microversion: 2.1 time: 0.223043 May 27 15:17:05.804550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 152/325] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:05 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1710 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:06.456402 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-da03907f-5471-4d7a-8c72-d334fdae836b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:06.457086 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-da03907f-5471-4d7a-8c72-d334fdae836b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:06.464218 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9a0b41b2-4a96-4c41-bf45-d1088639cc19 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:06.465411 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9a0b41b2-4a96-4c41-bf45-d1088639cc19 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:06.475660 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9a0b41b2-4a96-4c41-bf45-d1088639cc19 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:06.476107 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9a0b41b2-4a96-4c41-bf45-d1088639cc19 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:06.478914 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9a0b41b2-4a96-4c41-bf45-d1088639cc19 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:06.480392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9a0b41b2-4a96-4c41-bf45-d1088639cc19 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:06.481990 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-da03907f-5471-4d7a-8c72-d334fdae836b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:06.482592 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-da03907f-5471-4d7a-8c72-d334fdae836b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:06.483564 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-da03907f-5471-4d7a-8c72-d334fdae836b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:06.488475 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-da03907f-5471-4d7a-8c72-d334fdae836b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:06.727648 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9a0b41b2-4a96-4c41-bf45-d1088639cc19 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:06.738283 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9a0b41b2-4a96-4c41-bf45-d1088639cc19 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:06.739861 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9a0b41b2-4a96-4c41-bf45-d1088639cc19 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:06.740994 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9a0b41b2-4a96-4c41-bf45-d1088639cc19 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1737 microversion: 2.20 time: 0.280678 May 27 15:17:06.747754 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-da03907f-5471-4d7a-8c72-d334fdae836b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:06.754629 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 153/326] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:06 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1737 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:06.756391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-da03907f-5471-4d7a-8c72-d334fdae836b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.304462 May 27 15:17:06.758883 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 174/327] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:06 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:06.779826 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-1124d44b-5b29-41da-bea3-79d7dbf2d599 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:06.780445 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-1124d44b-5b29-41da-bea3-79d7dbf2d599 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:06.787316 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1124d44b-5b29-41da-bea3-79d7dbf2d599 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:06.787983 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1124d44b-5b29-41da-bea3-79d7dbf2d599 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:06.788799 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1124d44b-5b29-41da-bea3-79d7dbf2d599 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:06.789241 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1124d44b-5b29-41da-bea3-79d7dbf2d599 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:06.821931 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b6bda15c-e373-42c9-8178-4dd2f90bcc33 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:06.822542 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b6bda15c-e373-42c9-8178-4dd2f90bcc33 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:06.824532 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=100 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:06.836744 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b6bda15c-e373-42c9-8178-4dd2f90bcc33 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:06.837197 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b6bda15c-e373-42c9-8178-4dd2f90bcc33 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:06.837967 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b6bda15c-e373-42c9-8178-4dd2f90bcc33 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:06.838395 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b6bda15c-e373-42c9-8178-4dd2f90bcc33 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:07.033129 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-1124d44b-5b29-41da-bea3-79d7dbf2d599 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:07.047159 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-1124d44b-5b29-41da-bea3-79d7dbf2d599 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.277142 May 27 15:17:07.052117 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 154/328] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:06 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:07.085279 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b6bda15c-e373-42c9-8178-4dd2f90bcc33 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:07.097266 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b6bda15c-e373-42c9-8178-4dd2f90bcc33 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1710 microversion: 2.1 time: 0.279542 May 27 15:17:07.103184 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 175/329] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:06 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1710 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:07.762133 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f49be211-5b60-4de2-9137-c73d27da9be2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:07.763381 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-f49be211-5b60-4de2-9137-c73d27da9be2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:07.765720 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:07.771363 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f49be211-5b60-4de2-9137-c73d27da9be2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:07.772148 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f49be211-5b60-4de2-9137-c73d27da9be2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:07.773074 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f49be211-5b60-4de2-9137-c73d27da9be2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:07.773795 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f49be211-5b60-4de2-9137-c73d27da9be2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:07.776432 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-a3f9f709-e2db-4a08-aa46-919402f94061 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:07.777093 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-a3f9f709-e2db-4a08-aa46-919402f94061 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:07.785894 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a3f9f709-e2db-4a08-aa46-919402f94061 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:07.786440 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a3f9f709-e2db-4a08-aa46-919402f94061 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:07.787574 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a3f9f709-e2db-4a08-aa46-919402f94061 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:07.788075 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a3f9f709-e2db-4a08-aa46-919402f94061 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:08.010346 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f49be211-5b60-4de2-9137-c73d27da9be2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:08.020435 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f49be211-5b60-4de2-9137-c73d27da9be2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:08.022604 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f49be211-5b60-4de2-9137-c73d27da9be2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:08.024005 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-f49be211-5b60-4de2-9137-c73d27da9be2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1737 microversion: 2.20 time: 0.266412 May 27 15:17:08.031055 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 155/330] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:07 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1737 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:08.044456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-a3f9f709-e2db-4a08-aa46-919402f94061 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:08.057040 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-a3f9f709-e2db-4a08-aa46-919402f94061 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.284176 May 27 15:17:08.068516 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-357681ff-8724-4cab-a346-e26b6d84b687 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:08.069519 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-357681ff-8724-4cab-a346-e26b6d84b687 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:08.069948 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 176/331] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:07 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:08.076686 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-357681ff-8724-4cab-a346-e26b6d84b687 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:08.078101 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-357681ff-8724-4cab-a346-e26b6d84b687 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:08.079204 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-357681ff-8724-4cab-a346-e26b6d84b687 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:08.079903 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-357681ff-8724-4cab-a346-e26b6d84b687 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:08.115409 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-d3ade720-0bfc-4ab2-b27b-6ff997faad7a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:08.116207 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-d3ade720-0bfc-4ab2-b27b-6ff997faad7a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:08.130411 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d3ade720-0bfc-4ab2-b27b-6ff997faad7a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:08.131278 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d3ade720-0bfc-4ab2-b27b-6ff997faad7a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:08.132304 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d3ade720-0bfc-4ab2-b27b-6ff997faad7a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:08.132958 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d3ade720-0bfc-4ab2-b27b-6ff997faad7a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:08.378490 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-357681ff-8724-4cab-a346-e26b6d84b687 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:08.382949 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-d3ade720-0bfc-4ab2-b27b-6ff997faad7a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:08.392078 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-357681ff-8724-4cab-a346-e26b6d84b687 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.328015 May 27 15:17:08.392390 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-d3ade720-0bfc-4ab2-b27b-6ff997faad7a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1710 microversion: 2.1 time: 0.280823 May 27 15:17:08.392983 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 177/332] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:08 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1710 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:08.402930 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 156/333] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:08 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:09.042790 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-1aafc92d-b29e-4dea-b71a-7245c8e7c0f9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:09.043427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-1aafc92d-b29e-4dea-b71a-7245c8e7c0f9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:09.049947 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1aafc92d-b29e-4dea-b71a-7245c8e7c0f9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:09.050425 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1aafc92d-b29e-4dea-b71a-7245c8e7c0f9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:09.051413 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1aafc92d-b29e-4dea-b71a-7245c8e7c0f9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:09.051999 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1aafc92d-b29e-4dea-b71a-7245c8e7c0f9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:09.077717 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-928355e0-f9d9-4af6-b6e5-a2124bd9def8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:09.079012 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-928355e0-f9d9-4af6-b6e5-a2124bd9def8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:09.096655 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-928355e0-f9d9-4af6-b6e5-a2124bd9def8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:09.097109 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-928355e0-f9d9-4af6-b6e5-a2124bd9def8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:09.098078 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-928355e0-f9d9-4af6-b6e5-a2124bd9def8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:09.098678 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-928355e0-f9d9-4af6-b6e5-a2124bd9def8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:09.302676 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-928355e0-f9d9-4af6-b6e5-a2124bd9def8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:09.313652 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-928355e0-f9d9-4af6-b6e5-a2124bd9def8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.240383 May 27 15:17:09.314697 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 157/334] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:09 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:09.343161 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-1aafc92d-b29e-4dea-b71a-7245c8e7c0f9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:09.355929 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-1aafc92d-b29e-4dea-b71a-7245c8e7c0f9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:09.357485 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-1aafc92d-b29e-4dea-b71a-7245c8e7c0f9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:09.358661 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-1aafc92d-b29e-4dea-b71a-7245c8e7c0f9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1737 microversion: 2.20 time: 0.319915 May 27 15:17:09.360334 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 178/335] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:09 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1737 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:09.412406 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b76fb4a5-d8ca-4bd2-9f22-ec5dc980e11f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:09.413008 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b76fb4a5-d8ca-4bd2-9f22-ec5dc980e11f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:09.421601 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-5fde9216-1614-4fc8-9c40-664e2b3df450 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:09.423350 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-5fde9216-1614-4fc8-9c40-664e2b3df450 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:09.430029 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b76fb4a5-d8ca-4bd2-9f22-ec5dc980e11f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:09.434202 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b76fb4a5-d8ca-4bd2-9f22-ec5dc980e11f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:09.435204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b76fb4a5-d8ca-4bd2-9f22-ec5dc980e11f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:09.435833 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b76fb4a5-d8ca-4bd2-9f22-ec5dc980e11f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:09.436735 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5fde9216-1614-4fc8-9c40-664e2b3df450 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:09.437354 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5fde9216-1614-4fc8-9c40-664e2b3df450 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:09.438439 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5fde9216-1614-4fc8-9c40-664e2b3df450 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:09.439533 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5fde9216-1614-4fc8-9c40-664e2b3df450 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:09.480198 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=100 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:09.695178 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-5fde9216-1614-4fc8-9c40-664e2b3df450 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:09.697029 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b76fb4a5-d8ca-4bd2-9f22-ec5dc980e11f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:09.704741 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b76fb4a5-d8ca-4bd2-9f22-ec5dc980e11f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1522 microversion: 2.1 time: 0.296053 May 27 15:17:09.706256 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-5fde9216-1614-4fc8-9c40-664e2b3df450 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1710 microversion: 2.1 time: 0.299630 May 27 15:17:09.716369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 179/336] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:09 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:09.720036 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 158/337] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:09 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1710 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:09.971573 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-8c5d9bb1-07c1-458f-af3d-34df8c5103d9 req-1b82c662-c2b7-421a-ad1e-e545b9cd4be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d29ebf-5c93-4f7c-b372-121a8843600c", "name": "network-vif-plugged", "status": "completed", "tag": "499011f1-9fc8-4630-a680-e75f00a1b0e3"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:09.988256 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-8c5d9bb1-07c1-458f-af3d-34df8c5103d9 req-1b82c662-c2b7-421a-ad1e-e545b9cd4be3 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:09.988785 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-8c5d9bb1-07c1-458f-af3d-34df8c5103d9 req-1b82c662-c2b7-421a-ad1e-e545b9cd4be3 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:10.021112 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-8c5d9bb1-07c1-458f-af3d-34df8c5103d9 req-1b82c662-c2b7-421a-ad1e-e545b9cd4be3 service nova] Creating event network-vif-plugged:499011f1-9fc8-4630-a680-e75f00a1b0e3 for instance c4d29ebf-5c93-4f7c-b372-121a8843600c on hv-cinder-84254 May 27 15:17:10.039483 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-8c5d9bb1-07c1-458f-af3d-34df8c5103d9 req-1b82c662-c2b7-421a-ad1e-e545b9cd4be3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072219 May 27 15:17:10.043471 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 180/338] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:10.331224 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b8f8182b-2c5c-4445-a203-71c6001f7d97 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:10.332457 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b8f8182b-2c5c-4445-a203-71c6001f7d97 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:10.339122 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b8f8182b-2c5c-4445-a203-71c6001f7d97 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:10.339574 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b8f8182b-2c5c-4445-a203-71c6001f7d97 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:10.340350 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b8f8182b-2c5c-4445-a203-71c6001f7d97 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:10.340784 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b8f8182b-2c5c-4445-a203-71c6001f7d97 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:10.379044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-51265155-261a-4a67-85fa-1b507958376b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:10.380112 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-51265155-261a-4a67-85fa-1b507958376b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:10.387161 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-51265155-261a-4a67-85fa-1b507958376b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:10.399582 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-51265155-261a-4a67-85fa-1b507958376b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:10.403759 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-51265155-261a-4a67-85fa-1b507958376b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:10.404386 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-51265155-261a-4a67-85fa-1b507958376b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:10.583822 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b8f8182b-2c5c-4445-a203-71c6001f7d97 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:10.595770 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b8f8182b-2c5c-4445-a203-71c6001f7d97 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.268220 May 27 15:17:10.598420 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 159/339] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:10 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:10.644439 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-51265155-261a-4a67-85fa-1b507958376b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:10.654769 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-51265155-261a-4a67-85fa-1b507958376b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:10.656982 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-51265155-261a-4a67-85fa-1b507958376b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:10.659053 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-51265155-261a-4a67-85fa-1b507958376b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1737 microversion: 2.20 time: 0.284719 May 27 15:17:10.671523 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 181/340] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:10 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1737 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:10.721826 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-43ffe057-0178-4f2e-9ef0-78f9c54b1215 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:10.722431 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-43ffe057-0178-4f2e-9ef0-78f9c54b1215 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:10.724325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-1a6e6acb-5e8e-44c9-a7af-5309976f2bc5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:10.725521 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-1a6e6acb-5e8e-44c9-a7af-5309976f2bc5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:10.731921 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-43ffe057-0178-4f2e-9ef0-78f9c54b1215 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:10.732578 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-43ffe057-0178-4f2e-9ef0-78f9c54b1215 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:10.733535 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-43ffe057-0178-4f2e-9ef0-78f9c54b1215 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:10.734127 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-43ffe057-0178-4f2e-9ef0-78f9c54b1215 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:10.746299 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1a6e6acb-5e8e-44c9-a7af-5309976f2bc5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:10.747242 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1a6e6acb-5e8e-44c9-a7af-5309976f2bc5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:10.748220 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1a6e6acb-5e8e-44c9-a7af-5309976f2bc5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:10.748815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1a6e6acb-5e8e-44c9-a7af-5309976f2bc5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:10.974903 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-43ffe057-0178-4f2e-9ef0-78f9c54b1215 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:10.988166 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-43ffe057-0178-4f2e-9ef0-78f9c54b1215 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1502 microversion: 2.1 time: 0.270320 May 27 15:17:10.988542 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-1a6e6acb-5e8e-44c9-a7af-5309976f2bc5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:11.003445 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 160/341] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:10 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1502 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:11.006318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-1a6e6acb-5e8e-44c9-a7af-5309976f2bc5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1714 microversion: 2.1 time: 0.286449 May 27 15:17:11.007074 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 182/342] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:10 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1714 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:11.009144 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-329d568a-0c45-4365-8056-3279ed994000 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:11.009923 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-329d568a-0c45-4365-8056-3279ed994000 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:11.018020 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-329d568a-0c45-4365-8056-3279ed994000 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:11.018610 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-329d568a-0c45-4365-8056-3279ed994000 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:11.019532 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-329d568a-0c45-4365-8056-3279ed994000 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:11.020049 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-329d568a-0c45-4365-8056-3279ed994000 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:11.249897 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-329d568a-0c45-4365-8056-3279ed994000 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:11.268204 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-329d568a-0c45-4365-8056-3279ed994000 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1515 microversion: 2.1 time: 0.263197 May 27 15:17:11.270255 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 161/343] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:11 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1515 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:11.615737 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8fc9b159-bcb2-40f2-af08-0d9015f556da tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:11.617495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-8fc9b159-bcb2-40f2-af08-0d9015f556da tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:11.624763 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8fc9b159-bcb2-40f2-af08-0d9015f556da tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:11.625416 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8fc9b159-bcb2-40f2-af08-0d9015f556da tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:11.626411 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8fc9b159-bcb2-40f2-af08-0d9015f556da tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:11.627021 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8fc9b159-bcb2-40f2-af08-0d9015f556da tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:11.683371 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-6894b75b-a4af-4498-9b42-85a4b98e06db tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:11.684993 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-6894b75b-a4af-4498-9b42-85a4b98e06db tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:11.695591 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6894b75b-a4af-4498-9b42-85a4b98e06db tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:11.701027 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6894b75b-a4af-4498-9b42-85a4b98e06db tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:11.701027 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6894b75b-a4af-4498-9b42-85a4b98e06db tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:11.702024 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6894b75b-a4af-4498-9b42-85a4b98e06db tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:11.997501 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-6894b75b-a4af-4498-9b42-85a4b98e06db tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:12.012228 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-6894b75b-a4af-4498-9b42-85a4b98e06db tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:12.023439 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-6894b75b-a4af-4498-9b42-85a4b98e06db tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:12.025008 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-6894b75b-a4af-4498-9b42-85a4b98e06db tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1737 microversion: 2.20 time: 0.347066 May 27 15:17:12.037169 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 162/344] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:11 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1737 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:17:12.128584 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-8fc9b159-bcb2-40f2-af08-0d9015f556da tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:12.131019 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-dbb77e42-d131-41ad-a941-5e78aef8d986 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1586962401", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-504926628", "security_groups": [{"name": "tempest-secgroup-smoke-1034671319"}], "block_device_mapping_v2": [{"uuid": "e4cdc785-4e11-4673-995f-75ea313d05ab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2342e702-bd4d-4c84-b0ae-7b5944b1b9c3"}]}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:12.141469 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-8fc9b159-bcb2-40f2-af08-0d9015f556da tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1358 microversion: 2.1 time: 0.530068 May 27 15:17:12.142168 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 183/345] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:11 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1358 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:12.383332 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.network.neutron [None req-dbb77e42-d131-41ad-a941-5e78aef8d986 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] validate_networks() for [('2342e702-bd4d-4c84-b0ae-7b5944b1b9c3', None, None, None, None, None)] {{(pid=117743) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:17:13.045476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-bf656f46-a89f-4733-83ab-2d455a9578d9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:13.046182 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-bf656f46-a89f-4733-83ab-2d455a9578d9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:13.052677 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bf656f46-a89f-4733-83ab-2d455a9578d9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:13.061596 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bf656f46-a89f-4733-83ab-2d455a9578d9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:13.062585 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bf656f46-a89f-4733-83ab-2d455a9578d9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:13.063233 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bf656f46-a89f-4733-83ab-2d455a9578d9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:13.475269 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-dbb77e42-d131-41ad-a941-5e78aef8d986 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Flavor limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:17:13.476363 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-dbb77e42-d131-41ad-a941-5e78aef8d986 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Image limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:17:13.477042 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-dbb77e42-d131-41ad-a941-5e78aef8d986 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Flavor pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:17:13.477775 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-dbb77e42-d131-41ad-a941-5e78aef8d986 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Image pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:17:13.478424 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-dbb77e42-d131-41ad-a941-5e78aef8d986 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:17:13.494562 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-dbb77e42-d131-41ad-a941-5e78aef8d986 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:13.497717 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-dbb77e42-d131-41ad-a941-5e78aef8d986 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:13.499263 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-dbb77e42-d131-41ad-a941-5e78aef8d986 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:13.501959 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-dbb77e42-d131-41ad-a941-5e78aef8d986 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:13.537910 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-bf656f46-a89f-4733-83ab-2d455a9578d9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:13.550204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-bf656f46-a89f-4733-83ab-2d455a9578d9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:13.552942 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-bf656f46-a89f-4733-83ab-2d455a9578d9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:13.560548 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-bf656f46-a89f-4733-83ab-2d455a9578d9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1737 microversion: 2.20 time: 0.516464 May 27 15:17:13.560970 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-dbb77e42-d131-41ad-a941-5e78aef8d986 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Getting quotas for project f88bb4c8b75c4ad6be62f2cf5cf509c4. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:17:13.561936 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 184/346] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:13 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1737 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:17:13.568271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-60f9ddfa-9fa3-4eec-91e2-7390a6c8f39d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:13.569795 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-60f9ddfa-9fa3-4eec-91e2-7390a6c8f39d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:13.574097 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-dbb77e42-d131-41ad-a941-5e78aef8d986 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Getting quotas for user af74115f423c43fdb2544876be4e5622 and project f88bb4c8b75c4ad6be62f2cf5cf509c4. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:17:13.578791 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-60f9ddfa-9fa3-4eec-91e2-7390a6c8f39d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:13.579727 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-60f9ddfa-9fa3-4eec-91e2-7390a6c8f39d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:13.581346 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-60f9ddfa-9fa3-4eec-91e2-7390a6c8f39d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:13.582267 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-60f9ddfa-9fa3-4eec-91e2-7390a6c8f39d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:13.617190 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.objects.instance [None req-60f9ddfa-9fa3-4eec-91e2-7390a6c8f39d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lazy-loading 'flavor' on Instance uuid 5c20afff-0f88-4fdf-9394-7025ab53044a {{(pid=117742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:17:13.712256 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-dbb77e42-d131-41ad-a941-5e78aef8d986 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Going to run 1 instances... {{(pid=117743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:17:13.715120 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-dbb77e42-d131-41ad-a941-5e78aef8d986 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e4cdc785-4e11-4673-995f-75ea313d05ab',volume_size=None,volume_type=None)] {{(pid=117743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:17:13.733402 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:13.766074 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-60f9ddfa-9fa3-4eec-91e2-7390a6c8f39d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "POST /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a/action" status: 200 len: 32 microversion: 2.1 time: 0.202631 May 27 15:17:13.766940 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 185/347] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 15:17:13 2022] POST /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a/action => generated 32 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:17:13.772582 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-0af315ad-4dd1-43ad-a11b-09d70a0b21fb tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:13.773573 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-0af315ad-4dd1-43ad-a11b-09d70a0b21fb tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:13.782284 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0af315ad-4dd1-43ad-a11b-09d70a0b21fb tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:13.782934 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0af315ad-4dd1-43ad-a11b-09d70a0b21fb tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:13.783865 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0af315ad-4dd1-43ad-a11b-09d70a0b21fb tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:13.784452 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0af315ad-4dd1-43ad-a11b-09d70a0b21fb tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:14.000116 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-0af315ad-4dd1-43ad-a11b-09d70a0b21fb tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:14.010909 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-0af315ad-4dd1-43ad-a11b-09d70a0b21fb tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1549 microversion: 2.1 time: 0.242387 May 27 15:17:14.024479 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 186/348] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:13 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1549 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:14.031332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-96545208-5438-4356-a2ed-0a2668d5ba98 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:14.032238 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-96545208-5438-4356-a2ed-0a2668d5ba98 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:14.039083 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-96545208-5438-4356-a2ed-0a2668d5ba98 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:14.039740 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-96545208-5438-4356-a2ed-0a2668d5ba98 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:14.040681 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-96545208-5438-4356-a2ed-0a2668d5ba98 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:14.041272 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-96545208-5438-4356-a2ed-0a2668d5ba98 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:14.106165 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-dbb77e42-d131-41ad-a941-5e78aef8d986 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.978753 May 27 15:17:14.106165 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 163/349] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 15:17:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:17:14.112975 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-be96b4fe-a59d-42ea-839d-e00c9f49518b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:14.114140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-be96b4fe-a59d-42ea-839d-e00c9f49518b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:14.125939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-be96b4fe-a59d-42ea-839d-e00c9f49518b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:14.126388 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-be96b4fe-a59d-42ea-839d-e00c9f49518b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:14.127296 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-be96b4fe-a59d-42ea-839d-e00c9f49518b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:14.127721 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-be96b4fe-a59d-42ea-839d-e00c9f49518b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:14.355881 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-96545208-5438-4356-a2ed-0a2668d5ba98 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:14.363416 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-96545208-5438-4356-a2ed-0a2668d5ba98 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.337253 May 27 15:17:14.375231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 187/350] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:14 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:14.380072 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-4f3a84e4-7057-4870-8130-a426b5d55eee tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:14.380694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-4f3a84e4-7057-4870-8130-a426b5d55eee tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:14.491090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-4f3a84e4-7057-4870-8130-a426b5d55eee tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:14.499803 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-4f3a84e4-7057-4870-8130-a426b5d55eee tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1094 microversion: 2.1 time: 0.123413 May 27 15:17:14.501345 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 188/351] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:14 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1094 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:14.527625 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-be96b4fe-a59d-42ea-839d-e00c9f49518b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:14.544646 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-be96b4fe-a59d-42ea-839d-e00c9f49518b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1549 microversion: 2.1 time: 0.435674 May 27 15:17:14.547358 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 164/352] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:14 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1549 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:14.561774 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-52e9f881-6903-4a2e-abcf-1b3ae66e005b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:14.565325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-52e9f881-6903-4a2e-abcf-1b3ae66e005b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:14.566446 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-52e9f881-6903-4a2e-abcf-1b3ae66e005b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Searching by: {'deleted': False, 'project_id': '7facd29ad0d746099537a1b1345c2c90'} {{(pid=117742) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 15:17:14.575103 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-52e9f881-6903-4a2e-abcf-1b3ae66e005b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:14.575916 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-52e9f881-6903-4a2e-abcf-1b3ae66e005b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:14.576934 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-52e9f881-6903-4a2e-abcf-1b3ae66e005b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:14.577577 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-52e9f881-6903-4a2e-abcf-1b3ae66e005b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:14.586107 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9c375605-1407-4756-9617-177297d85295 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:14.587109 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9c375605-1407-4756-9617-177297d85295 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:14.598975 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9c375605-1407-4756-9617-177297d85295 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:14.599661 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9c375605-1407-4756-9617-177297d85295 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:14.600711 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9c375605-1407-4756-9617-177297d85295 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:14.601358 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9c375605-1407-4756-9617-177297d85295 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:14.732998 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.multi_cell_list [None req-52e9f881-6903-4a2e-abcf-1b3ae66e005b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117742) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 15:17:14.871436 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-52e9f881-6903-4a2e-abcf-1b3ae66e005b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.314251 May 27 15:17:14.877992 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 189/353] 10.222.0.50 () {58 vars in 1124 bytes} [Fri May 27 15:17:14 2022] GET /compute/v2.1/servers => generated 342 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:14.884187 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-bd4eeffc-59cd-49c8-b672-54b060720ef4 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:14.885079 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-bd4eeffc-59cd-49c8-b672-54b060720ef4 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:14.892492 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bd4eeffc-59cd-49c8-b672-54b060720ef4 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:14.893971 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bd4eeffc-59cd-49c8-b672-54b060720ef4 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:14.896059 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bd4eeffc-59cd-49c8-b672-54b060720ef4 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:14.896701 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bd4eeffc-59cd-49c8-b672-54b060720ef4 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:15.102178 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9c375605-1407-4756-9617-177297d85295 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:15.118809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9c375605-1407-4756-9617-177297d85295 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:15.120638 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9c375605-1407-4756-9617-177297d85295 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:15.121837 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9c375605-1407-4756-9617-177297d85295 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1719 microversion: 2.20 time: 0.539601 May 27 15:17:15.127114 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 165/354] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:14 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1719 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:17:15.291358 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-bd4eeffc-59cd-49c8-b672-54b060720ef4 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:15.306768 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-bd4eeffc-59cd-49c8-b672-54b060720ef4 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1549 microversion: 2.1 time: 0.427510 May 27 15:17:15.312889 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 190/355] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:14 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1549 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:15.382494 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-921af5ca-7567-4cd3-a0df-c1022c992e7f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:15.383482 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-921af5ca-7567-4cd3-a0df-c1022c992e7f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:15.397112 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-921af5ca-7567-4cd3-a0df-c1022c992e7f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:15.397917 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-921af5ca-7567-4cd3-a0df-c1022c992e7f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:15.399793 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-921af5ca-7567-4cd3-a0df-c1022c992e7f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:15.401757 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-921af5ca-7567-4cd3-a0df-c1022c992e7f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:15.520007 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-d6e7d0b3-8f8b-4005-bffc-fea43ff35719 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:15.521343 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-d6e7d0b3-8f8b-4005-bffc-fea43ff35719 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:15.527885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d6e7d0b3-8f8b-4005-bffc-fea43ff35719 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:15.528680 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d6e7d0b3-8f8b-4005-bffc-fea43ff35719 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:15.529905 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d6e7d0b3-8f8b-4005-bffc-fea43ff35719 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:15.530821 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d6e7d0b3-8f8b-4005-bffc-fea43ff35719 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:15.636720 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-d6e7d0b3-8f8b-4005-bffc-fea43ff35719 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:15.654826 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-d6e7d0b3-8f8b-4005-bffc-fea43ff35719 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1192 microversion: 2.1 time: 0.139987 May 27 15:17:15.657468 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 191/356] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:15 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1192 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:15.841197 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-921af5ca-7567-4cd3-a0df-c1022c992e7f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:15.858481 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-921af5ca-7567-4cd3-a0df-c1022c992e7f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.479013 May 27 15:17:15.862155 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 166/357] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:15 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:16.140947 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-43eb0305-0369-4aa9-8758-bf66c96dd16a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:16.141155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-43eb0305-0369-4aa9-8758-bf66c96dd16a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:16.158361 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-43eb0305-0369-4aa9-8758-bf66c96dd16a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:16.159824 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-43eb0305-0369-4aa9-8758-bf66c96dd16a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:16.162374 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-43eb0305-0369-4aa9-8758-bf66c96dd16a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:16.165995 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-43eb0305-0369-4aa9-8758-bf66c96dd16a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:16.675246 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-bafd9204-4228-48e5-bf76-17c59a344d66 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:16.675978 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-bafd9204-4228-48e5-bf76-17c59a344d66 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:16.704846 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bafd9204-4228-48e5-bf76-17c59a344d66 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:16.705926 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bafd9204-4228-48e5-bf76-17c59a344d66 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:16.708143 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bafd9204-4228-48e5-bf76-17c59a344d66 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:16.710705 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bafd9204-4228-48e5-bf76-17c59a344d66 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:16.889416 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-bafd9204-4228-48e5-bf76-17c59a344d66 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:16.896938 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-bafd9204-4228-48e5-bf76-17c59a344d66 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1210 microversion: 2.1 time: 0.227268 May 27 15:17:16.897602 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 167/358] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:16 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1210 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:16.902752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9b6c3fb4-2b0e-432c-9012-edfe9616c7a8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:16.903462 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9b6c3fb4-2b0e-432c-9012-edfe9616c7a8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:16.909539 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9b6c3fb4-2b0e-432c-9012-edfe9616c7a8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:16.910090 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9b6c3fb4-2b0e-432c-9012-edfe9616c7a8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:16.910966 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9b6c3fb4-2b0e-432c-9012-edfe9616c7a8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:16.911479 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9b6c3fb4-2b0e-432c-9012-edfe9616c7a8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:16.925044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-43eb0305-0369-4aa9-8758-bf66c96dd16a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:16.933441 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-43eb0305-0369-4aa9-8758-bf66c96dd16a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:16.935150 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-43eb0305-0369-4aa9-8758-bf66c96dd16a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:16.936256 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-43eb0305-0369-4aa9-8758-bf66c96dd16a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1719 microversion: 2.20 time: 0.800120 May 27 15:17:16.937320 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 192/359] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:16 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1719 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:17.175098 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9b6c3fb4-2b0e-432c-9012-edfe9616c7a8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:17.193090 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9b6c3fb4-2b0e-432c-9012-edfe9616c7a8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.294371 May 27 15:17:17.194332 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 168/360] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:16 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:17.490649 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-6e881a88-4399-49d0-85fd-e3874eef103c tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf97fb43-3c89-4fc0-a71c-cc6bcf0a8177"}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:17.492913 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-6e881a88-4399-49d0-85fd-e3874eef103c tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:17.501214 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6e881a88-4399-49d0-85fd-e3874eef103c tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:17.501885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6e881a88-4399-49d0-85fd-e3874eef103c tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:17.502767 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6e881a88-4399-49d0-85fd-e3874eef103c tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:17.503302 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6e881a88-4399-49d0-85fd-e3874eef103c tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:17.918999 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-bd21f704-9a2f-4063-b876-f5319a1c43b8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:17.920531 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-bd21f704-9a2f-4063-b876-f5319a1c43b8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:17.949349 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bd21f704-9a2f-4063-b876-f5319a1c43b8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:17.950474 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bd21f704-9a2f-4063-b876-f5319a1c43b8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:17.953518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bd21f704-9a2f-4063-b876-f5319a1c43b8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:17.954411 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bd21f704-9a2f-4063-b876-f5319a1c43b8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:18.130455 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-bd21f704-9a2f-4063-b876-f5319a1c43b8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:18.188843 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-bd21f704-9a2f-4063-b876-f5319a1c43b8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1210 microversion: 2.1 time: 0.262219 May 27 15:17:18.189929 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 169/361] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:17 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1210 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:18.207102 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-bc03d89a-f276-49b8-bb8b-eaf81d94102a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:18.209542 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-bc03d89a-f276-49b8-bb8b-eaf81d94102a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:18.225209 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bc03d89a-f276-49b8-bb8b-eaf81d94102a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:18.228252 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bc03d89a-f276-49b8-bb8b-eaf81d94102a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:18.233696 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bc03d89a-f276-49b8-bb8b-eaf81d94102a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:18.234573 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bc03d89a-f276-49b8-bb8b-eaf81d94102a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:18.433866 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-6e881a88-4399-49d0-85fd-e3874eef103c tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "POST /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.948327 May 27 15:17:18.443188 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 193/362] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 15:17:17 2022] POST /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c/os-volume_attachments => generated 194 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:18.458973 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-4b8e761e-c5e0-44ac-ab7b-1637c828772c req-0aa78f21-f315-47e3-8031-a6b1be9f6e25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88bbd4b-d173-4df5-9e19-4fedb81b4aed", "name": "network-vif-unplugged", "status": "completed", "tag": "b65a7130-71a7-4267-9201-c07ec8e83b00"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:18.476327 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-4b8e761e-c5e0-44ac-ab7b-1637c828772c req-0aa78f21-f315-47e3-8031-a6b1be9f6e25 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:18.478344 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-4b8e761e-c5e0-44ac-ab7b-1637c828772c req-0aa78f21-f315-47e3-8031-a6b1be9f6e25 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:18.517222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-4b8e761e-c5e0-44ac-ab7b-1637c828772c req-0aa78f21-f315-47e3-8031-a6b1be9f6e25 service nova] Creating event network-vif-unplugged:b65a7130-71a7-4267-9201-c07ec8e83b00 for instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed on hv-cinder-84254 May 27 15:17:18.527539 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-4b8e761e-c5e0-44ac-ab7b-1637c828772c req-0aa78f21-f315-47e3-8031-a6b1be9f6e25 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079954 May 27 15:17:18.528487 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 194/363] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:18.533873 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-bc03d89a-f276-49b8-bb8b-eaf81d94102a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:18.544534 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-46ec5246-9403-4755-9add-7c6abe1429dc tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:18.546654 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-46ec5246-9403-4755-9add-7c6abe1429dc tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:18.547344 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-bc03d89a-f276-49b8-bb8b-eaf81d94102a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:18.551188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-bc03d89a-f276-49b8-bb8b-eaf81d94102a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:18.554230 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-bc03d89a-f276-49b8-bb8b-eaf81d94102a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1722 microversion: 2.20 time: 0.362839 May 27 15:17:18.555798 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 170/364] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:18 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1722 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:18.570337 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-46ec5246-9403-4755-9add-7c6abe1429dc tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:18.571109 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-46ec5246-9403-4755-9add-7c6abe1429dc tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:18.576852 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-46ec5246-9403-4755-9add-7c6abe1429dc tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:18.577814 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-46ec5246-9403-4755-9add-7c6abe1429dc tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:18.585022 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-0abdff13-9f65-4ace-8611-c24d3a1cd667 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e46c944-c90f-4612-a961-81d33b1b69ed"}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:18.586693 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-0abdff13-9f65-4ace-8611-c24d3a1cd667 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:18.603553 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0abdff13-9f65-4ace-8611-c24d3a1cd667 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:18.604544 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0abdff13-9f65-4ace-8611-c24d3a1cd667 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:18.605613 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0abdff13-9f65-4ace-8611-c24d3a1cd667 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:18.606327 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0abdff13-9f65-4ace-8611-c24d3a1cd667 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:19.008255 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-46ec5246-9403-4755-9add-7c6abe1429dc tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:19.033247 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-46ec5246-9403-4755-9add-7c6abe1429dc tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.501520 May 27 15:17:19.039882 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 195/365] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:18 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:19.208558 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b5aa2dd2-73b7-44fe-a9c0-9418661e7a7b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:19.209562 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b5aa2dd2-73b7-44fe-a9c0-9418661e7a7b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:19.249507 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b5aa2dd2-73b7-44fe-a9c0-9418661e7a7b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:19.250343 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b5aa2dd2-73b7-44fe-a9c0-9418661e7a7b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:19.252225 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b5aa2dd2-73b7-44fe-a9c0-9418661e7a7b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:19.254188 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b5aa2dd2-73b7-44fe-a9c0-9418661e7a7b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:19.473106 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-0abdff13-9f65-4ace-8611-c24d3a1cd667 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "POST /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.900969 May 27 15:17:19.475595 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 171/366] 10.222.0.50 () {62 vars in 1363 bytes} [Fri May 27 15:17:18 2022] POST /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed/os-volume_attachments => generated 188 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:17:19.563619 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b5aa2dd2-73b7-44fe-a9c0-9418661e7a7b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:19.576160 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b5aa2dd2-73b7-44fe-a9c0-9418661e7a7b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1266 microversion: 2.1 time: 0.373933 May 27 15:17:19.577619 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 196/367] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:19 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1266 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:20.060276 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a1eff55a-bffa-4961-ba6c-a0cbcfa5e480 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:20.061136 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a1eff55a-bffa-4961-ba6c-a0cbcfa5e480 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:20.081977 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a1eff55a-bffa-4961-ba6c-a0cbcfa5e480 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:20.084396 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a1eff55a-bffa-4961-ba6c-a0cbcfa5e480 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:20.089141 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a1eff55a-bffa-4961-ba6c-a0cbcfa5e480 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:20.090427 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a1eff55a-bffa-4961-ba6c-a0cbcfa5e480 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:20.275611 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-be107c9b-6b25-4628-8d81-3a84bf4727fa tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:20.276474 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-be107c9b-6b25-4628-8d81-3a84bf4727fa tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:20.284009 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-be107c9b-6b25-4628-8d81-3a84bf4727fa tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:20.284482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-be107c9b-6b25-4628-8d81-3a84bf4727fa tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:20.285284 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-be107c9b-6b25-4628-8d81-3a84bf4727fa tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:20.285712 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-be107c9b-6b25-4628-8d81-3a84bf4727fa tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:20.369980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a1eff55a-bffa-4961-ba6c-a0cbcfa5e480 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:20.387378 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a1eff55a-bffa-4961-ba6c-a0cbcfa5e480 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.326203 May 27 15:17:20.402174 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 172/368] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:20 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:20.424312 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-207088cf-3f26-470d-b0af-50f96f1cf559 req-4f39fa93-ea9c-4f7f-b636-621663094be6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b00f36f-8f62-43f7-bdeb-71c22904dd0a", "tag": "3b5cfd14-7448-43de-994e-2bf2d7ae2d0b"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:20.457519 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-207088cf-3f26-470d-b0af-50f96f1cf559 req-4f39fa93-ea9c-4f7f-b636-621663094be6 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:20.458084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-207088cf-3f26-470d-b0af-50f96f1cf559 req-4f39fa93-ea9c-4f7f-b636-621663094be6 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:20.474469 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:20.479280 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-207088cf-3f26-470d-b0af-50f96f1cf559 req-4f39fa93-ea9c-4f7f-b636-621663094be6 service nova] Creating event network-changed:3b5cfd14-7448-43de-994e-2bf2d7ae2d0b for instance 0b00f36f-8f62-43f7-bdeb-71c22904dd0a on hv-cinder-84254 May 27 15:17:20.485861 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-207088cf-3f26-470d-b0af-50f96f1cf559 req-4f39fa93-ea9c-4f7f-b636-621663094be6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080879 May 27 15:17:20.487275 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 173/369] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:20.538583 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-be107c9b-6b25-4628-8d81-3a84bf4727fa tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "POST /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed/action" status: 202 len: 0 microversion: 2.20 time: 0.267544 May 27 15:17:20.539227 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 197/370] 10.222.0.50 () {62 vars in 1318 bytes} [Fri May 27 15:17:20 2022] POST /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 15:17:20.548141 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-cb93f921-875b-48c1-b391-aa1b3570b844 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:20.549042 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-cb93f921-875b-48c1-b391-aa1b3570b844 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:20.564429 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-cb93f921-875b-48c1-b391-aa1b3570b844 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:20.564878 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-cb93f921-875b-48c1-b391-aa1b3570b844 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:20.566105 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-cb93f921-875b-48c1-b391-aa1b3570b844 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:20.566728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-cb93f921-875b-48c1-b391-aa1b3570b844 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:20.598972 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e2ba11b8-574b-405f-b924-09a9b08697f6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:20.600148 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e2ba11b8-574b-405f-b924-09a9b08697f6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:20.636762 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e2ba11b8-574b-405f-b924-09a9b08697f6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:20.638560 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e2ba11b8-574b-405f-b924-09a9b08697f6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:20.642362 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e2ba11b8-574b-405f-b924-09a9b08697f6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:20.644572 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e2ba11b8-574b-405f-b924-09a9b08697f6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:21.076027 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-cb93f921-875b-48c1-b391-aa1b3570b844 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:21.090924 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-cb93f921-875b-48c1-b391-aa1b3570b844 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:21.096237 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-cb93f921-875b-48c1-b391-aa1b3570b844 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:21.098104 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-cb93f921-875b-48c1-b391-aa1b3570b844 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1748 microversion: 2.20 time: 0.554431 May 27 15:17:21.100253 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 174/371] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:20 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1748 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:21.122218 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-e2ba11b8-574b-405f-b924-09a9b08697f6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:21.131711 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-e2ba11b8-574b-405f-b924-09a9b08697f6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1266 microversion: 2.1 time: 0.541678 May 27 15:17:21.132300 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 198/372] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:20 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1266 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:21.405748 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f50377c5-e6b8-4ea0-940e-a40f45e9fbc7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:21.406355 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-f50377c5-e6b8-4ea0-940e-a40f45e9fbc7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:21.413717 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f50377c5-e6b8-4ea0-940e-a40f45e9fbc7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:21.414206 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f50377c5-e6b8-4ea0-940e-a40f45e9fbc7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:21.415315 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f50377c5-e6b8-4ea0-940e-a40f45e9fbc7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:21.415757 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f50377c5-e6b8-4ea0-940e-a40f45e9fbc7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:21.573764 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f50377c5-e6b8-4ea0-940e-a40f45e9fbc7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:21.582774 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-f50377c5-e6b8-4ea0-940e-a40f45e9fbc7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.180973 May 27 15:17:21.583901 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 175/373] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:21 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:22.123189 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-76578cb0-37f3-4242-aea7-fd6f9724bce4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:22.123953 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-76578cb0-37f3-4242-aea7-fd6f9724bce4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:22.132262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-76578cb0-37f3-4242-aea7-fd6f9724bce4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:22.133015 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-76578cb0-37f3-4242-aea7-fd6f9724bce4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:22.134115 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-76578cb0-37f3-4242-aea7-fd6f9724bce4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:22.134623 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-76578cb0-37f3-4242-aea7-fd6f9724bce4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:22.152042 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9ae39663-6ef2-442f-8a03-73f41ebea7b3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:22.152748 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9ae39663-6ef2-442f-8a03-73f41ebea7b3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:22.183864 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9ae39663-6ef2-442f-8a03-73f41ebea7b3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:22.187749 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9ae39663-6ef2-442f-8a03-73f41ebea7b3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:22.188595 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9ae39663-6ef2-442f-8a03-73f41ebea7b3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:22.189040 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9ae39663-6ef2-442f-8a03-73f41ebea7b3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:22.386678 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-76578cb0-37f3-4242-aea7-fd6f9724bce4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:22.398025 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-76578cb0-37f3-4242-aea7-fd6f9724bce4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:22.400737 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-76578cb0-37f3-4242-aea7-fd6f9724bce4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:22.402534 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-76578cb0-37f3-4242-aea7-fd6f9724bce4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1748 microversion: 2.20 time: 0.288669 May 27 15:17:22.403658 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 199/374] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:22 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1748 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:17:22.445876 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9ae39663-6ef2-442f-8a03-73f41ebea7b3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:22.454168 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9ae39663-6ef2-442f-8a03-73f41ebea7b3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1266 microversion: 2.1 time: 0.308296 May 27 15:17:22.454755 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 176/375] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:22 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1266 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:22.600081 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e8b1b255-c2ac-4cd9-b799-9de71d3e9d0d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:22.600615 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e8b1b255-c2ac-4cd9-b799-9de71d3e9d0d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:22.607775 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e8b1b255-c2ac-4cd9-b799-9de71d3e9d0d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:22.608410 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e8b1b255-c2ac-4cd9-b799-9de71d3e9d0d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:22.609293 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e8b1b255-c2ac-4cd9-b799-9de71d3e9d0d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:22.609797 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e8b1b255-c2ac-4cd9-b799-9de71d3e9d0d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:22.748701 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-e8b1b255-c2ac-4cd9-b799-9de71d3e9d0d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:22.751318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:22.769875 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-e8b1b255-c2ac-4cd9-b799-9de71d3e9d0d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.173635 May 27 15:17:22.781696 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 200/376] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:22 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:23.422459 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-8e9c73a8-4c41-4a72-be53-f25a4828fcc0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:23.423754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-8e9c73a8-4c41-4a72-be53-f25a4828fcc0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:23.436536 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8e9c73a8-4c41-4a72-be53-f25a4828fcc0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:23.437509 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8e9c73a8-4c41-4a72-be53-f25a4828fcc0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:23.438567 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8e9c73a8-4c41-4a72-be53-f25a4828fcc0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:23.439290 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8e9c73a8-4c41-4a72-be53-f25a4828fcc0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:23.477415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-6b9fd1d4-17d5-421d-9dd1-194ba376e303 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:23.478271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-6b9fd1d4-17d5-421d-9dd1-194ba376e303 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:23.490096 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6b9fd1d4-17d5-421d-9dd1-194ba376e303 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:23.491803 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6b9fd1d4-17d5-421d-9dd1-194ba376e303 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:23.495346 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6b9fd1d4-17d5-421d-9dd1-194ba376e303 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:23.499401 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6b9fd1d4-17d5-421d-9dd1-194ba376e303 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:23.523987 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=2 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:23.587603 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=6 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:23.675086 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-8e9c73a8-4c41-4a72-be53-f25a4828fcc0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:23.689934 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-8e9c73a8-4c41-4a72-be53-f25a4828fcc0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:23.692289 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-8e9c73a8-4c41-4a72-be53-f25a4828fcc0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:23.693716 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-8e9c73a8-4c41-4a72-be53-f25a4828fcc0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1748 microversion: 2.20 time: 0.275549 May 27 15:17:23.695355 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 177/377] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:23 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1748 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:23.753118 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6b9fd1d4-17d5-421d-9dd1-194ba376e303 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:23.768693 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-6b9fd1d4-17d5-421d-9dd1-194ba376e303 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1266 microversion: 2.1 time: 0.301780 May 27 15:17:23.784136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 201/378] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:23 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1266 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:23.789936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-e819253b-c92d-4a86-b84a-ab94160a9967 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:23.790919 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-e819253b-c92d-4a86-b84a-ab94160a9967 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:23.807479 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e819253b-c92d-4a86-b84a-ab94160a9967 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:23.808530 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e819253b-c92d-4a86-b84a-ab94160a9967 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:23.810458 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e819253b-c92d-4a86-b84a-ab94160a9967 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:23.811937 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e819253b-c92d-4a86-b84a-ab94160a9967 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:23.944133 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-e819253b-c92d-4a86-b84a-ab94160a9967 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:23.953420 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-e819253b-c92d-4a86-b84a-ab94160a9967 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.167875 May 27 15:17:23.953993 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 178/379] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:23 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:24.712949 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-2460e437-1579-4679-a67c-e97003cea8de tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:24.714321 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-2460e437-1579-4679-a67c-e97003cea8de tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:24.716455 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=2 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:24.717091 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=2 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:24.723466 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2460e437-1579-4679-a67c-e97003cea8de tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:24.724165 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2460e437-1579-4679-a67c-e97003cea8de tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:24.724939 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2460e437-1579-4679-a67c-e97003cea8de tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:24.725531 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2460e437-1579-4679-a67c-e97003cea8de tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:24.788899 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-4e0c7d17-ee3d-4f1b-a114-4225d34aaafa tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:24.789511 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-4e0c7d17-ee3d-4f1b-a114-4225d34aaafa tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:24.796487 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4e0c7d17-ee3d-4f1b-a114-4225d34aaafa tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:24.797158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4e0c7d17-ee3d-4f1b-a114-4225d34aaafa tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:24.797956 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4e0c7d17-ee3d-4f1b-a114-4225d34aaafa tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:24.798383 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4e0c7d17-ee3d-4f1b-a114-4225d34aaafa tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:24.961156 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-2460e437-1579-4679-a67c-e97003cea8de tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:24.981333 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-2460e437-1579-4679-a67c-e97003cea8de tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:24.983791 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-2460e437-1579-4679-a67c-e97003cea8de tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:24.985338 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-2460e437-1579-4679-a67c-e97003cea8de tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1748 microversion: 2.20 time: 0.276484 May 27 15:17:24.986455 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 202/380] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:24 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1748 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:24.991893 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-60e6be02-ac2d-4986-95b8-68eb8d1c63a5 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:24.993078 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-60e6be02-ac2d-4986-95b8-68eb8d1c63a5 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:25.001654 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-60e6be02-ac2d-4986-95b8-68eb8d1c63a5 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:25.002601 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-60e6be02-ac2d-4986-95b8-68eb8d1c63a5 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:25.003956 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-60e6be02-ac2d-4986-95b8-68eb8d1c63a5 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:25.005147 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-60e6be02-ac2d-4986-95b8-68eb8d1c63a5 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:25.045325 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-4e0c7d17-ee3d-4f1b-a114-4225d34aaafa tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:25.053661 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-4e0c7d17-ee3d-4f1b-a114-4225d34aaafa tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1266 microversion: 2.1 time: 0.268557 May 27 15:17:25.065418 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 179/381] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:24 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:25.200626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-60e6be02-ac2d-4986-95b8-68eb8d1c63a5 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:25.210435 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-60e6be02-ac2d-4986-95b8-68eb8d1c63a5 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.222472 May 27 15:17:25.212006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 203/382] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:24 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:26.005575 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9ee5a89f-f038-4823-8838-7c4ccd1db5cc tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:26.006429 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9ee5a89f-f038-4823-8838-7c4ccd1db5cc tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:26.013220 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9ee5a89f-f038-4823-8838-7c4ccd1db5cc tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:26.013867 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9ee5a89f-f038-4823-8838-7c4ccd1db5cc tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:26.014867 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9ee5a89f-f038-4823-8838-7c4ccd1db5cc tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:26.015422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9ee5a89f-f038-4823-8838-7c4ccd1db5cc tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:26.072116 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-aff37351-479d-44df-bf1a-2de83c02db62 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:26.073524 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-aff37351-479d-44df-bf1a-2de83c02db62 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:26.086977 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-aff37351-479d-44df-bf1a-2de83c02db62 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:26.087427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-aff37351-479d-44df-bf1a-2de83c02db62 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:26.088382 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-aff37351-479d-44df-bf1a-2de83c02db62 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:26.089147 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-aff37351-479d-44df-bf1a-2de83c02db62 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:26.257640 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9ee5a89f-f038-4823-8838-7c4ccd1db5cc tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:26.269608 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9ee5a89f-f038-4823-8838-7c4ccd1db5cc tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:26.271666 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9ee5a89f-f038-4823-8838-7c4ccd1db5cc tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:26.273082 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9ee5a89f-f038-4823-8838-7c4ccd1db5cc tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1748 microversion: 2.20 time: 0.271955 May 27 15:17:26.273642 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 180/383] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:25 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1748 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:26.280380 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-ee24ace1-0209-4b73-8de1-cb93b0c65f17 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:26.281306 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-ee24ace1-0209-4b73-8de1-cb93b0c65f17 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:26.288618 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ee24ace1-0209-4b73-8de1-cb93b0c65f17 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:26.289119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ee24ace1-0209-4b73-8de1-cb93b0c65f17 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:26.290283 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ee24ace1-0209-4b73-8de1-cb93b0c65f17 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:26.292173 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ee24ace1-0209-4b73-8de1-cb93b0c65f17 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:26.299011 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-aff37351-479d-44df-bf1a-2de83c02db62 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:26.315318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-aff37351-479d-44df-bf1a-2de83c02db62 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1266 microversion: 2.1 time: 0.247137 May 27 15:17:26.315909 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 204/384] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:26 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:26.477602 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-ee24ace1-0209-4b73-8de1-cb93b0c65f17 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:26.487090 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-ee24ace1-0209-4b73-8de1-cb93b0c65f17 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.211885 May 27 15:17:26.487678 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 181/385] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:26 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:27.293583 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-34f2d960-03a7-48a5-aaac-d3a26daa1227 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:27.294404 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-34f2d960-03a7-48a5-aaac-d3a26daa1227 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:27.302381 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-34f2d960-03a7-48a5-aaac-d3a26daa1227 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:27.302943 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-34f2d960-03a7-48a5-aaac-d3a26daa1227 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:27.303976 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-34f2d960-03a7-48a5-aaac-d3a26daa1227 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:27.304621 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-34f2d960-03a7-48a5-aaac-d3a26daa1227 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:27.333106 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a98400d4-ed7b-44a3-9ba3-1b039eca3803 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:27.334459 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a98400d4-ed7b-44a3-9ba3-1b039eca3803 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:27.351959 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a98400d4-ed7b-44a3-9ba3-1b039eca3803 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:27.352735 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a98400d4-ed7b-44a3-9ba3-1b039eca3803 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:27.354275 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a98400d4-ed7b-44a3-9ba3-1b039eca3803 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:27.354896 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a98400d4-ed7b-44a3-9ba3-1b039eca3803 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:27.538809 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-34f2d960-03a7-48a5-aaac-d3a26daa1227 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:27.556079 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-34f2d960-03a7-48a5-aaac-d3a26daa1227 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:27.560690 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-34f2d960-03a7-48a5-aaac-d3a26daa1227 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:27.574014 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-34f2d960-03a7-48a5-aaac-d3a26daa1227 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1748 microversion: 2.20 time: 0.274225 May 27 15:17:27.575066 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a98400d4-ed7b-44a3-9ba3-1b039eca3803 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:27.575175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 205/386] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:27 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1748 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:17:27.575258 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a98400d4-ed7b-44a3-9ba3-1b039eca3803 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1266 microversion: 2.1 time: 0.241825 May 27 15:17:27.575258 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 182/387] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:27 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:27.591105 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-01e7e5cb-2083-4f0a-8040-03b8c0e2662d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:27.592748 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-01e7e5cb-2083-4f0a-8040-03b8c0e2662d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:27.605907 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-01e7e5cb-2083-4f0a-8040-03b8c0e2662d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:27.606373 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-01e7e5cb-2083-4f0a-8040-03b8c0e2662d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:27.607154 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-01e7e5cb-2083-4f0a-8040-03b8c0e2662d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:27.607595 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-01e7e5cb-2083-4f0a-8040-03b8c0e2662d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:27.746143 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-01e7e5cb-2083-4f0a-8040-03b8c0e2662d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:27.753748 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-01e7e5cb-2083-4f0a-8040-03b8c0e2662d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.167377 May 27 15:17:27.754314 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 206/388] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:27 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:28.586390 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-e2fccd34-0007-43e8-9c4c-1686ea2763ac tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:28.587400 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-e2fccd34-0007-43e8-9c4c-1686ea2763ac tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:28.589099 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-3f10cf0c-368f-4d6b-a638-7d4b6f5d44e4 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:28.589681 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-3f10cf0c-368f-4d6b-a638-7d4b6f5d44e4 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:28.596754 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3f10cf0c-368f-4d6b-a638-7d4b6f5d44e4 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:28.596908 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e2fccd34-0007-43e8-9c4c-1686ea2763ac tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:28.597202 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3f10cf0c-368f-4d6b-a638-7d4b6f5d44e4 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:28.597475 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e2fccd34-0007-43e8-9c4c-1686ea2763ac tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:28.598044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3f10cf0c-368f-4d6b-a638-7d4b6f5d44e4 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:28.598473 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3f10cf0c-368f-4d6b-a638-7d4b6f5d44e4 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:28.598612 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e2fccd34-0007-43e8-9c4c-1686ea2763ac tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:28.599339 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e2fccd34-0007-43e8-9c4c-1686ea2763ac tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:28.865595 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-e2fccd34-0007-43e8-9c4c-1686ea2763ac tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:28.872966 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-3f10cf0c-368f-4d6b-a638-7d4b6f5d44e4 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:28.875506 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-e2fccd34-0007-43e8-9c4c-1686ea2763ac tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:28.877053 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-e2fccd34-0007-43e8-9c4c-1686ea2763ac tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:28.878411 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-e2fccd34-0007-43e8-9c4c-1686ea2763ac tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1748 microversion: 2.20 time: 0.300044 May 27 15:17:28.879259 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 183/389] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:28 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1748 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:28.883837 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f1aca8e4-6c93-432e-a4b7-0ac82790bb27 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:28.884671 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-f1aca8e4-6c93-432e-a4b7-0ac82790bb27 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:28.893297 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-3f10cf0c-368f-4d6b-a638-7d4b6f5d44e4 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1266 microversion: 2.1 time: 0.307733 May 27 15:17:28.893917 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f1aca8e4-6c93-432e-a4b7-0ac82790bb27 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:28.894374 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f1aca8e4-6c93-432e-a4b7-0ac82790bb27 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:28.895263 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 207/390] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:28 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1266 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:28.895619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f1aca8e4-6c93-432e-a4b7-0ac82790bb27 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:28.896213 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f1aca8e4-6c93-432e-a4b7-0ac82790bb27 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:29.073649 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f1aca8e4-6c93-432e-a4b7-0ac82790bb27 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:29.081772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-f1aca8e4-6c93-432e-a4b7-0ac82790bb27 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.201357 May 27 15:17:29.082366 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 184/391] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:28 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:29.897875 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-bddac0de-c8cb-45f8-888f-477cc0f26902 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:29.898477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-bddac0de-c8cb-45f8-888f-477cc0f26902 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:29.906141 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bddac0de-c8cb-45f8-888f-477cc0f26902 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:29.906593 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bddac0de-c8cb-45f8-888f-477cc0f26902 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:29.909005 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bddac0de-c8cb-45f8-888f-477cc0f26902 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:29.909465 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bddac0de-c8cb-45f8-888f-477cc0f26902 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:29.913845 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-0fc43661-1387-4c5b-9421-013dace917a0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:29.914548 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-0fc43661-1387-4c5b-9421-013dace917a0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:29.922238 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0fc43661-1387-4c5b-9421-013dace917a0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:29.922693 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0fc43661-1387-4c5b-9421-013dace917a0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:29.923493 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0fc43661-1387-4c5b-9421-013dace917a0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:29.923932 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0fc43661-1387-4c5b-9421-013dace917a0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:30.127218 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-bddac0de-c8cb-45f8-888f-477cc0f26902 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:30.133426 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-0fc43661-1387-4c5b-9421-013dace917a0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:30.136576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-bddac0de-c8cb-45f8-888f-477cc0f26902 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:30.138447 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-bddac0de-c8cb-45f8-888f-477cc0f26902 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:30.139673 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-bddac0de-c8cb-45f8-888f-477cc0f26902 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1748 microversion: 2.20 time: 0.245980 May 27 15:17:30.140230 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 208/392] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:29 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1748 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:30.141287 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-0fc43661-1387-4c5b-9421-013dace917a0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1266 microversion: 2.1 time: 0.231445 May 27 15:17:30.142224 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 185/393] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:29 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:30.145487 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f3fed7ad-ccbd-4ee1-a1af-4a37eaba8949 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:30.146084 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f3fed7ad-ccbd-4ee1-a1af-4a37eaba8949 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:30.152625 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f3fed7ad-ccbd-4ee1-a1af-4a37eaba8949 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:30.153069 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f3fed7ad-ccbd-4ee1-a1af-4a37eaba8949 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:30.153831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f3fed7ad-ccbd-4ee1-a1af-4a37eaba8949 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:30.154279 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f3fed7ad-ccbd-4ee1-a1af-4a37eaba8949 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:30.297127 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f3fed7ad-ccbd-4ee1-a1af-4a37eaba8949 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:30.304738 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f3fed7ad-ccbd-4ee1-a1af-4a37eaba8949 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.163176 May 27 15:17:30.305318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 209/394] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:30 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:31.161022 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-cb6b9d40-e9e5-4bc8-a6c2-df5ab400ae2b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:31.162993 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-cb6b9d40-e9e5-4bc8-a6c2-df5ab400ae2b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:31.170196 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-1768bf44-0cff-4416-a781-21fe31cd4cd5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:31.170812 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-1768bf44-0cff-4416-a781-21fe31cd4cd5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:31.179220 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1768bf44-0cff-4416-a781-21fe31cd4cd5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:31.180012 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1768bf44-0cff-4416-a781-21fe31cd4cd5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:31.181020 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1768bf44-0cff-4416-a781-21fe31cd4cd5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:31.182776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1768bf44-0cff-4416-a781-21fe31cd4cd5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:31.190036 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-cb6b9d40-e9e5-4bc8-a6c2-df5ab400ae2b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:31.190496 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-cb6b9d40-e9e5-4bc8-a6c2-df5ab400ae2b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:31.194448 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-cb6b9d40-e9e5-4bc8-a6c2-df5ab400ae2b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:31.196681 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-cb6b9d40-e9e5-4bc8-a6c2-df5ab400ae2b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:31.466296 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-1768bf44-0cff-4416-a781-21fe31cd4cd5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:31.483509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-1768bf44-0cff-4416-a781-21fe31cd4cd5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:31.485323 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-1768bf44-0cff-4416-a781-21fe31cd4cd5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:31.486685 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-1768bf44-0cff-4416-a781-21fe31cd4cd5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1748 microversion: 2.20 time: 0.323486 May 27 15:17:31.487746 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 210/395] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:31 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1748 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:31.493145 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-0ca6f876-5ffd-4a1a-b56f-e5048b0065cb tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:31.493748 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-0ca6f876-5ffd-4a1a-b56f-e5048b0065cb tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:31.508591 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0ca6f876-5ffd-4a1a-b56f-e5048b0065cb tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:31.509364 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0ca6f876-5ffd-4a1a-b56f-e5048b0065cb tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:31.510386 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0ca6f876-5ffd-4a1a-b56f-e5048b0065cb tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:31.511127 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0ca6f876-5ffd-4a1a-b56f-e5048b0065cb tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:31.519393 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-cb6b9d40-e9e5-4bc8-a6c2-df5ab400ae2b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:31.527456 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-cb6b9d40-e9e5-4bc8-a6c2-df5ab400ae2b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1266 microversion: 2.1 time: 0.372200 May 27 15:17:31.528115 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 186/396] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:31 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1266 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:31.649601 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-0ca6f876-5ffd-4a1a-b56f-e5048b0065cb tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:31.657722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-0ca6f876-5ffd-4a1a-b56f-e5048b0065cb tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.168812 May 27 15:17:31.658273 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 211/397] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:31 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:32.128966 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-c88a5986-f336-46ae-8a0b-e6dcc043d5ab tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:32.130133 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-c88a5986-f336-46ae-8a0b-e6dcc043d5ab tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:32.138471 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c88a5986-f336-46ae-8a0b-e6dcc043d5ab tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:32.139106 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c88a5986-f336-46ae-8a0b-e6dcc043d5ab tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:32.140288 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c88a5986-f336-46ae-8a0b-e6dcc043d5ab tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:32.140852 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c88a5986-f336-46ae-8a0b-e6dcc043d5ab tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:32.324397 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-c88a5986-f336-46ae-8a0b-e6dcc043d5ab tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:32.332685 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-c88a5986-f336-46ae-8a0b-e6dcc043d5ab tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1595 microversion: 2.1 time: 0.209021 May 27 15:17:32.333249 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 187/398] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:32 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1595 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:32.506876 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-a4bc29de-9c6d-4e0a-9d1c-cdcf17cf9de0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:32.507887 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-a4bc29de-9c6d-4e0a-9d1c-cdcf17cf9de0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:32.518779 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a4bc29de-9c6d-4e0a-9d1c-cdcf17cf9de0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:32.519538 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a4bc29de-9c6d-4e0a-9d1c-cdcf17cf9de0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:32.520752 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a4bc29de-9c6d-4e0a-9d1c-cdcf17cf9de0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:32.521863 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a4bc29de-9c6d-4e0a-9d1c-cdcf17cf9de0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:32.544597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d7f6cd23-0099-4acb-9632-c8fed1dad6ab tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:32.545211 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-d7f6cd23-0099-4acb-9632-c8fed1dad6ab tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:32.554934 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d7f6cd23-0099-4acb-9632-c8fed1dad6ab tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:32.555465 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d7f6cd23-0099-4acb-9632-c8fed1dad6ab tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:32.556161 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d7f6cd23-0099-4acb-9632-c8fed1dad6ab tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:32.557148 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d7f6cd23-0099-4acb-9632-c8fed1dad6ab tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:32.864708 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d7f6cd23-0099-4acb-9632-c8fed1dad6ab tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:32.872873 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-d7f6cd23-0099-4acb-9632-c8fed1dad6ab tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1266 microversion: 2.1 time: 0.332328 May 27 15:17:32.874001 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 188/399] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:32 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1266 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:32.878658 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-dadca85a-3bcd-475d-bdf1-8c9e3926f648 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:32.879494 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-dadca85a-3bcd-475d-bdf1-8c9e3926f648 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:32.882522 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-a4bc29de-9c6d-4e0a-9d1c-cdcf17cf9de0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:32.887938 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-dadca85a-3bcd-475d-bdf1-8c9e3926f648 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:32.888558 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-dadca85a-3bcd-475d-bdf1-8c9e3926f648 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:32.889788 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-dadca85a-3bcd-475d-bdf1-8c9e3926f648 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:32.890388 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-dadca85a-3bcd-475d-bdf1-8c9e3926f648 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:32.892523 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-a4bc29de-9c6d-4e0a-9d1c-cdcf17cf9de0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:32.894046 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-a4bc29de-9c6d-4e0a-9d1c-cdcf17cf9de0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:32.895259 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-a4bc29de-9c6d-4e0a-9d1c-cdcf17cf9de0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1748 microversion: 2.20 time: 0.393557 May 27 15:17:32.896183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 212/400] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:32 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1748 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:33.079867 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-dadca85a-3bcd-475d-bdf1-8c9e3926f648 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:33.088488 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-dadca85a-3bcd-475d-bdf1-8c9e3926f648 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.212780 May 27 15:17:33.089071 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 189/401] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:32 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:33.896083 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-9be32ddd-9088-430a-a74c-8c73bcb998eb tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:33.899017 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-9be32ddd-9088-430a-a74c-8c73bcb998eb tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:33.924754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-692de23b-c2fb-4fb4-9f42-c41504b7058f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:33.928653 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-692de23b-c2fb-4fb4-9f42-c41504b7058f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:33.945277 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9be32ddd-9088-430a-a74c-8c73bcb998eb tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:33.950112 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9be32ddd-9088-430a-a74c-8c73bcb998eb tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:33.960447 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9be32ddd-9088-430a-a74c-8c73bcb998eb tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:33.961898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9be32ddd-9088-430a-a74c-8c73bcb998eb tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:33.962794 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-692de23b-c2fb-4fb4-9f42-c41504b7058f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:33.967960 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-692de23b-c2fb-4fb4-9f42-c41504b7058f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:33.970423 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-692de23b-c2fb-4fb4-9f42-c41504b7058f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:33.974551 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-692de23b-c2fb-4fb4-9f42-c41504b7058f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:34.003180 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=100 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:34.294815 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-692de23b-c2fb-4fb4-9f42-c41504b7058f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:34.312544 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-692de23b-c2fb-4fb4-9f42-c41504b7058f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:34.320670 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-692de23b-c2fb-4fb4-9f42-c41504b7058f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:34.321992 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-692de23b-c2fb-4fb4-9f42-c41504b7058f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1748 microversion: 2.20 time: 0.412068 May 27 15:17:34.327540 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 190/402] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:33 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1748 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:17:34.345116 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-1d4390f8-22f7-45bc-87b0-fa6f22a04a75 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:34.348805 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-9be32ddd-9088-430a-a74c-8c73bcb998eb tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:34.359090 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-1d4390f8-22f7-45bc-87b0-fa6f22a04a75 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:34.359278 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-9be32ddd-9088-430a-a74c-8c73bcb998eb tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1266 microversion: 2.1 time: 0.470937 May 27 15:17:34.361769 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 213/403] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:33 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1266 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:34.367574 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-0fe57719-1c7b-466d-a842-6c19f07c248a req-6f9e34e6-9562-4a84-a689-85d525012c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b00f36f-8f62-43f7-bdeb-71c22904dd0a", "name": "network-vif-plugged", "status": "completed", "tag": "3b5cfd14-7448-43de-994e-2bf2d7ae2d0b"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:34.379627 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-0fe57719-1c7b-466d-a842-6c19f07c248a req-6f9e34e6-9562-4a84-a689-85d525012c61 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:34.380175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-0fe57719-1c7b-466d-a842-6c19f07c248a req-6f9e34e6-9562-4a84-a689-85d525012c61 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:34.383340 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1d4390f8-22f7-45bc-87b0-fa6f22a04a75 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:34.386183 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1d4390f8-22f7-45bc-87b0-fa6f22a04a75 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:34.387105 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1d4390f8-22f7-45bc-87b0-fa6f22a04a75 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:34.389015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1d4390f8-22f7-45bc-87b0-fa6f22a04a75 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:34.405862 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-0fe57719-1c7b-466d-a842-6c19f07c248a req-6f9e34e6-9562-4a84-a689-85d525012c61 service nova] Creating event network-vif-plugged:3b5cfd14-7448-43de-994e-2bf2d7ae2d0b for instance 0b00f36f-8f62-43f7-bdeb-71c22904dd0a on hv-cinder-84254 May 27 15:17:34.413766 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-0fe57719-1c7b-466d-a842-6c19f07c248a req-6f9e34e6-9562-4a84-a689-85d525012c61 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050362 May 27 15:17:34.414459 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 214/404] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:34.558326 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-1d4390f8-22f7-45bc-87b0-fa6f22a04a75 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:34.570212 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-1d4390f8-22f7-45bc-87b0-fa6f22a04a75 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.240802 May 27 15:17:34.571085 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 191/405] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:34 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:34.951249 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-b844e918-d987-437f-884c-01878ccf7707 req-7b88745f-1c45-49f6-b25c-51d8ef15f9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4d29ebf-5c93-4f7c-b372-121a8843600c", "tag": "499011f1-9fc8-4630-a680-e75f00a1b0e3"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:34.969731 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-b844e918-d987-437f-884c-01878ccf7707 req-7b88745f-1c45-49f6-b25c-51d8ef15f9e6 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:34.970468 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-b844e918-d987-437f-884c-01878ccf7707 req-7b88745f-1c45-49f6-b25c-51d8ef15f9e6 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:34.997582 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-b844e918-d987-437f-884c-01878ccf7707 req-7b88745f-1c45-49f6-b25c-51d8ef15f9e6 service nova] Creating event network-changed:499011f1-9fc8-4630-a680-e75f00a1b0e3 for instance c4d29ebf-5c93-4f7c-b372-121a8843600c on hv-cinder-84254 May 27 15:17:35.028009 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-b844e918-d987-437f-884c-01878ccf7707 req-7b88745f-1c45-49f6-b25c-51d8ef15f9e6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087661 May 27 15:17:35.028683 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 215/406] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:35.347906 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-fe9557ea-5903-41a3-9b16-8f26bee1d495 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:35.348635 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-fe9557ea-5903-41a3-9b16-8f26bee1d495 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:35.365816 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fe9557ea-5903-41a3-9b16-8f26bee1d495 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:35.366276 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fe9557ea-5903-41a3-9b16-8f26bee1d495 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:35.367102 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fe9557ea-5903-41a3-9b16-8f26bee1d495 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:35.370702 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fe9557ea-5903-41a3-9b16-8f26bee1d495 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:35.381970 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ff0b47a4-b7f0-44f3-822c-c8f79cde390a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:35.383033 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ff0b47a4-b7f0-44f3-822c-c8f79cde390a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:35.401132 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ff0b47a4-b7f0-44f3-822c-c8f79cde390a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:35.403287 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ff0b47a4-b7f0-44f3-822c-c8f79cde390a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:35.405429 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ff0b47a4-b7f0-44f3-822c-c8f79cde390a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:35.409635 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ff0b47a4-b7f0-44f3-822c-c8f79cde390a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:35.699626 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-fe9557ea-5903-41a3-9b16-8f26bee1d495 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:35.716410 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-fe9557ea-5903-41a3-9b16-8f26bee1d495 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:35.718317 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-fe9557ea-5903-41a3-9b16-8f26bee1d495 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:35.719241 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-ff0b47a4-b7f0-44f3-822c-c8f79cde390a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:35.720481 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-fe9557ea-5903-41a3-9b16-8f26bee1d495 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1748 microversion: 2.20 time: 0.383266 May 27 15:17:35.721723 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 192/407] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:35 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1748 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:35.726562 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d8f17838-21fb-4180-8718-8e6fc11a6fa2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:35.727580 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-d8f17838-21fb-4180-8718-8e6fc11a6fa2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:35.728554 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ff0b47a4-b7f0-44f3-822c-c8f79cde390a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1266 microversion: 2.1 time: 0.353996 May 27 15:17:35.734841 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d8f17838-21fb-4180-8718-8e6fc11a6fa2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:35.735621 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d8f17838-21fb-4180-8718-8e6fc11a6fa2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:35.736613 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d8f17838-21fb-4180-8718-8e6fc11a6fa2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:35.737264 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d8f17838-21fb-4180-8718-8e6fc11a6fa2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:35.739714 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 216/408] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:35 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1266 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:35.977026 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d8f17838-21fb-4180-8718-8e6fc11a6fa2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:35.995112 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-d8f17838-21fb-4180-8718-8e6fc11a6fa2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.271959 May 27 15:17:35.999556 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 193/409] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:35 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:36.459747 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-58b3aa71-9c39-457b-8cb7-ae104cfaffc8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1807613637"}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:36.460372 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-58b3aa71-9c39-457b-8cb7-ae104cfaffc8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:36.476069 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-58b3aa71-9c39-457b-8cb7-ae104cfaffc8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:36.477231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-58b3aa71-9c39-457b-8cb7-ae104cfaffc8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:36.478696 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-58b3aa71-9c39-457b-8cb7-ae104cfaffc8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:36.479782 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-58b3aa71-9c39-457b-8cb7-ae104cfaffc8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:36.632307 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.network.security_group_api [None req-58b3aa71-9c39-457b-8cb7-ae104cfaffc8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Adding security group 7c24bb86-dd26-42a4-9857-37932d852490 to port 499011f1-9fc8-4630-a680-e75f00a1b0e3 May 27 15:17:36.739506 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-cebd5df3-0a9a-41f5-8d81-28b2240a60c2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:36.740143 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-cebd5df3-0a9a-41f5-8d81-28b2240a60c2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:36.748109 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-cebd5df3-0a9a-41f5-8d81-28b2240a60c2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:36.748565 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-cebd5df3-0a9a-41f5-8d81-28b2240a60c2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:36.749339 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-cebd5df3-0a9a-41f5-8d81-28b2240a60c2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:36.749840 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-cebd5df3-0a9a-41f5-8d81-28b2240a60c2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:36.991509 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-cebd5df3-0a9a-41f5-8d81-28b2240a60c2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:37.003125 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-cebd5df3-0a9a-41f5-8d81-28b2240a60c2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:37.004621 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-cebd5df3-0a9a-41f5-8d81-28b2240a60c2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:37.006162 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-cebd5df3-0a9a-41f5-8d81-28b2240a60c2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1748 microversion: 2.20 time: 0.271529 May 27 15:17:37.018636 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 194/410] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:36 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1748 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:17:37.023635 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-cb515ea4-eed0-4a59-ace5-2162bea18827 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:37.024472 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-cb515ea4-eed0-4a59-ace5-2162bea18827 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:37.032830 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-cb515ea4-eed0-4a59-ace5-2162bea18827 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:37.034616 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-cb515ea4-eed0-4a59-ace5-2162bea18827 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:37.035646 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-cb515ea4-eed0-4a59-ace5-2162bea18827 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:37.036084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-cb515ea4-eed0-4a59-ace5-2162bea18827 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:37.233988 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-cb515ea4-eed0-4a59-ace5-2162bea18827 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:37.248560 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-cb515ea4-eed0-4a59-ace5-2162bea18827 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1266 microversion: 2.1 time: 0.228706 May 27 15:17:37.260304 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 195/411] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:37 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:37.265662 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a575e89b-f257-4746-91a2-9766c8714e71 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:37.266357 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a575e89b-f257-4746-91a2-9766c8714e71 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:37.286821 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-58b3aa71-9c39-457b-8cb7-ae104cfaffc8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "POST /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c/action" status: 202 len: 0 microversion: 2.1 time: 0.832359 May 27 15:17:37.287750 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 217/412] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 15:17:36 2022] POST /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c/action => generated 0 bytes in 834 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:17:37.294282 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a575e89b-f257-4746-91a2-9766c8714e71 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:37.295065 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a575e89b-f257-4746-91a2-9766c8714e71 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:37.295509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-c8eb478c-cf5a-4fab-8f0b-1fef4dee900d tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:37.296121 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-c8eb478c-cf5a-4fab-8f0b-1fef4dee900d tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:37.297310 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a575e89b-f257-4746-91a2-9766c8714e71 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:37.298424 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=90 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:37.299339 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a575e89b-f257-4746-91a2-9766c8714e71 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:37.312841 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c8eb478c-cf5a-4fab-8f0b-1fef4dee900d tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:37.313529 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c8eb478c-cf5a-4fab-8f0b-1fef4dee900d tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:37.331266 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c8eb478c-cf5a-4fab-8f0b-1fef4dee900d tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:37.331727 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c8eb478c-cf5a-4fab-8f0b-1fef4dee900d tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:37.690172 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a575e89b-f257-4746-91a2-9766c8714e71 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:37.699136 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a575e89b-f257-4746-91a2-9766c8714e71 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.437378 May 27 15:17:37.704728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 196/413] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:37 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:37.716270 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-918c6966-1cab-43e9-8226-67aabc4f4df3 req-228fbe21-e62a-4a46-8034-d5163051d981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4d29ebf-5c93-4f7c-b372-121a8843600c", "tag": "499011f1-9fc8-4630-a680-e75f00a1b0e3"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:37.733914 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:37.737185 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-918c6966-1cab-43e9-8226-67aabc4f4df3 req-228fbe21-e62a-4a46-8034-d5163051d981 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:37.738427 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-918c6966-1cab-43e9-8226-67aabc4f4df3 req-228fbe21-e62a-4a46-8034-d5163051d981 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:37.766402 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-c8eb478c-cf5a-4fab-8f0b-1fef4dee900d tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:37.775795 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-c8eb478c-cf5a-4fab-8f0b-1fef4dee900d tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1642 microversion: 2.1 time: 0.483390 May 27 15:17:37.776620 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 218/414] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:37 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1642 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:37.791509 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-918c6966-1cab-43e9-8226-67aabc4f4df3 req-228fbe21-e62a-4a46-8034-d5163051d981 service nova] Creating event network-changed:499011f1-9fc8-4630-a680-e75f00a1b0e3 for instance c4d29ebf-5c93-4f7c-b372-121a8843600c on hv-cinder-84254 May 27 15:17:37.798370 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-918c6966-1cab-43e9-8226-67aabc4f4df3 req-228fbe21-e62a-4a46-8034-d5163051d981 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091416 May 27 15:17:37.799576 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 197/415] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:38.027275 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-db6a1b8e-5e5d-476c-aec6-3e4bb5c786a6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:38.028141 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-db6a1b8e-5e5d-476c-aec6-3e4bb5c786a6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:38.057260 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-db6a1b8e-5e5d-476c-aec6-3e4bb5c786a6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:38.057733 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-db6a1b8e-5e5d-476c-aec6-3e4bb5c786a6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:38.058508 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-db6a1b8e-5e5d-476c-aec6-3e4bb5c786a6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:38.058985 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-db6a1b8e-5e5d-476c-aec6-3e4bb5c786a6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:38.064817 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=100 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:38.269462 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-5551075a-2e40-405c-9bd0-5020cdd989c3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:38.270162 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-5551075a-2e40-405c-9bd0-5020cdd989c3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:38.283464 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-db6a1b8e-5e5d-476c-aec6-3e4bb5c786a6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:38.287088 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5551075a-2e40-405c-9bd0-5020cdd989c3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:38.287758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5551075a-2e40-405c-9bd0-5020cdd989c3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:38.289671 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5551075a-2e40-405c-9bd0-5020cdd989c3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:38.290287 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5551075a-2e40-405c-9bd0-5020cdd989c3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:38.294995 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-db6a1b8e-5e5d-476c-aec6-3e4bb5c786a6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:38.311354 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-db6a1b8e-5e5d-476c-aec6-3e4bb5c786a6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:38.314828 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-db6a1b8e-5e5d-476c-aec6-3e4bb5c786a6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1748 microversion: 2.20 time: 0.292694 May 27 15:17:38.318769 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 219/416] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:38 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1748 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:38.558357 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-5551075a-2e40-405c-9bd0-5020cdd989c3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:38.571297 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-5551075a-2e40-405c-9bd0-5020cdd989c3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1452 microversion: 2.1 time: 0.308481 May 27 15:17:38.588230 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 198/417] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:38 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1452 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:38.592520 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-240c48e3-a943-4e61-a8dd-458801c2e4f0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:38.593123 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-240c48e3-a943-4e61-a8dd-458801c2e4f0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:38.600383 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-240c48e3-a943-4e61-a8dd-458801c2e4f0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:38.600914 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-240c48e3-a943-4e61-a8dd-458801c2e4f0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:38.601690 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-240c48e3-a943-4e61-a8dd-458801c2e4f0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:38.602155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-240c48e3-a943-4e61-a8dd-458801c2e4f0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:38.722133 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-52bc7ec7-3e40-400c-83f9-19afdd05eb25 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:38.723033 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-52bc7ec7-3e40-400c-83f9-19afdd05eb25 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:38.734366 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-52bc7ec7-3e40-400c-83f9-19afdd05eb25 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:38.734946 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-52bc7ec7-3e40-400c-83f9-19afdd05eb25 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:38.735793 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-52bc7ec7-3e40-400c-83f9-19afdd05eb25 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:38.739000 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-52bc7ec7-3e40-400c-83f9-19afdd05eb25 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:38.795231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-240c48e3-a943-4e61-a8dd-458801c2e4f0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:38.804576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-240c48e3-a943-4e61-a8dd-458801c2e4f0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1452 microversion: 2.1 time: 0.216130 May 27 15:17:38.805422 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 220/418] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:38 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1452 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:38.948196 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-52bc7ec7-3e40-400c-83f9-19afdd05eb25 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:38.958304 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-52bc7ec7-3e40-400c-83f9-19afdd05eb25 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.240197 May 27 15:17:38.958897 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 199/419] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:38 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:39.339411 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-47d85d73-f234-4297-b0b6-5d5816946df2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:39.340396 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-47d85d73-f234-4297-b0b6-5d5816946df2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:39.347858 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-47d85d73-f234-4297-b0b6-5d5816946df2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:39.348531 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-47d85d73-f234-4297-b0b6-5d5816946df2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:39.349572 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-47d85d73-f234-4297-b0b6-5d5816946df2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:39.350008 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-47d85d73-f234-4297-b0b6-5d5816946df2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:39.589475 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-47d85d73-f234-4297-b0b6-5d5816946df2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:39.608843 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-47d85d73-f234-4297-b0b6-5d5816946df2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:39.622474 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-47d85d73-f234-4297-b0b6-5d5816946df2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:39.624868 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-47d85d73-f234-4297-b0b6-5d5816946df2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1748 microversion: 2.20 time: 0.291051 May 27 15:17:39.625928 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 221/420] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:39 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1748 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:39.977815 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f9bdfcc8-9ac9-46ce-9874-668bb5749d2d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:39.979769 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-f9bdfcc8-9ac9-46ce-9874-668bb5749d2d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:40.012354 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f9bdfcc8-9ac9-46ce-9874-668bb5749d2d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:40.012888 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f9bdfcc8-9ac9-46ce-9874-668bb5749d2d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:40.013925 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f9bdfcc8-9ac9-46ce-9874-668bb5749d2d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:40.014542 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f9bdfcc8-9ac9-46ce-9874-668bb5749d2d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:40.551464 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f9bdfcc8-9ac9-46ce-9874-668bb5749d2d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:40.561038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-f9bdfcc8-9ac9-46ce-9874-668bb5749d2d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.587617 May 27 15:17:40.561618 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 200/421] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:39 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:40.647903 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-6c318438-a628-436d-bdb9-b85319571b3b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:40.649311 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-6c318438-a628-436d-bdb9-b85319571b3b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:40.665537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6c318438-a628-436d-bdb9-b85319571b3b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:40.666962 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6c318438-a628-436d-bdb9-b85319571b3b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:40.669033 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6c318438-a628-436d-bdb9-b85319571b3b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:40.669640 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6c318438-a628-436d-bdb9-b85319571b3b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:40.970420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6c318438-a628-436d-bdb9-b85319571b3b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:40.981105 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6c318438-a628-436d-bdb9-b85319571b3b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:40.982901 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6c318438-a628-436d-bdb9-b85319571b3b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:40.984255 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-6c318438-a628-436d-bdb9-b85319571b3b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1748 microversion: 2.20 time: 0.341369 May 27 15:17:40.995904 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 222/422] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:40 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1748 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:17:41.579190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-db42b63a-f4de-463f-8e28-3eb633aaa468 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:41.579975 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-db42b63a-f4de-463f-8e28-3eb633aaa468 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:41.598498 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-db42b63a-f4de-463f-8e28-3eb633aaa468 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:41.599082 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-db42b63a-f4de-463f-8e28-3eb633aaa468 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:41.599960 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-db42b63a-f4de-463f-8e28-3eb633aaa468 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:41.602286 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-db42b63a-f4de-463f-8e28-3eb633aaa468 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:41.954769 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-db42b63a-f4de-463f-8e28-3eb633aaa468 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:41.956969 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-d33e798d-f04b-48d4-8b81-2a1120fd3fb4 req-9c9e7fb3-39ce-4218-804f-4ad4f3f03811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b00f36f-8f62-43f7-bdeb-71c22904dd0a", "tag": "3b5cfd14-7448-43de-994e-2bf2d7ae2d0b"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:41.970910 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-db42b63a-f4de-463f-8e28-3eb633aaa468 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.395884 May 27 15:17:41.971388 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 201/423] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:41 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:41.992638 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-d33e798d-f04b-48d4-8b81-2a1120fd3fb4 req-9c9e7fb3-39ce-4218-804f-4ad4f3f03811 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:41.993181 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-d33e798d-f04b-48d4-8b81-2a1120fd3fb4 req-9c9e7fb3-39ce-4218-804f-4ad4f3f03811 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:42.007025 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-66afe852-4dc3-4b6b-945c-e049eceea8d0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:42.010152 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-66afe852-4dc3-4b6b-945c-e049eceea8d0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:42.021545 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-66afe852-4dc3-4b6b-945c-e049eceea8d0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:42.022281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-66afe852-4dc3-4b6b-945c-e049eceea8d0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:42.023232 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-66afe852-4dc3-4b6b-945c-e049eceea8d0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:42.024188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-66afe852-4dc3-4b6b-945c-e049eceea8d0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:42.024417 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-d33e798d-f04b-48d4-8b81-2a1120fd3fb4 req-9c9e7fb3-39ce-4218-804f-4ad4f3f03811 service nova] Creating event network-changed:3b5cfd14-7448-43de-994e-2bf2d7ae2d0b for instance 0b00f36f-8f62-43f7-bdeb-71c22904dd0a on hv-cinder-84254 May 27 15:17:42.030539 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-d33e798d-f04b-48d4-8b81-2a1120fd3fb4 req-9c9e7fb3-39ce-4218-804f-4ad4f3f03811 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081669 May 27 15:17:42.031508 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 223/424] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:42.187132 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-66afe852-4dc3-4b6b-945c-e049eceea8d0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:42.195391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-66afe852-4dc3-4b6b-945c-e049eceea8d0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:42.197000 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-66afe852-4dc3-4b6b-945c-e049eceea8d0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:42.198704 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-66afe852-4dc3-4b6b-945c-e049eceea8d0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1750 microversion: 2.20 time: 0.199506 May 27 15:17:42.199306 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 202/425] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:41 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1750 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:17:42.988585 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-2ddefe6d-be12-45ac-94f3-889a9396b34a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:42.989265 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-2ddefe6d-be12-45ac-94f3-889a9396b34a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:42.995451 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2ddefe6d-be12-45ac-94f3-889a9396b34a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:42.996111 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2ddefe6d-be12-45ac-94f3-889a9396b34a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:42.997030 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2ddefe6d-be12-45ac-94f3-889a9396b34a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:42.998249 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2ddefe6d-be12-45ac-94f3-889a9396b34a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:43.166728 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-2ddefe6d-be12-45ac-94f3-889a9396b34a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:43.174398 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-2ddefe6d-be12-45ac-94f3-889a9396b34a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.190405 May 27 15:17:43.175026 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 224/426] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:42 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:43.219180 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-63714e49-1a67-4afc-9361-df7efc71f19d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:43.220682 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-63714e49-1a67-4afc-9361-df7efc71f19d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:43.229384 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-63714e49-1a67-4afc-9361-df7efc71f19d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:43.229384 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-63714e49-1a67-4afc-9361-df7efc71f19d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:43.229905 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-63714e49-1a67-4afc-9361-df7efc71f19d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:43.230403 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-63714e49-1a67-4afc-9361-df7efc71f19d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:43.372678 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-63714e49-1a67-4afc-9361-df7efc71f19d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:43.383273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-63714e49-1a67-4afc-9361-df7efc71f19d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:43.385912 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-63714e49-1a67-4afc-9361-df7efc71f19d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:43.387417 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-63714e49-1a67-4afc-9361-df7efc71f19d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1750 microversion: 2.20 time: 0.173495 May 27 15:17:43.388481 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 203/427] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:43 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1750 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:44.190647 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ca82e1ea-c6ec-4853-984e-370723d96857 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:44.191948 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ca82e1ea-c6ec-4853-984e-370723d96857 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:44.198971 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ca82e1ea-c6ec-4853-984e-370723d96857 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:44.199417 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ca82e1ea-c6ec-4853-984e-370723d96857 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:44.200178 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ca82e1ea-c6ec-4853-984e-370723d96857 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:44.200647 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ca82e1ea-c6ec-4853-984e-370723d96857 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:44.407174 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a1574099-5105-4803-88b9-6aa78434b9f9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:44.408614 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a1574099-5105-4803-88b9-6aa78434b9f9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:44.422143 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a1574099-5105-4803-88b9-6aa78434b9f9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:44.422954 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a1574099-5105-4803-88b9-6aa78434b9f9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:44.423983 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a1574099-5105-4803-88b9-6aa78434b9f9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:44.424447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a1574099-5105-4803-88b9-6aa78434b9f9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:44.424733 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-ca82e1ea-c6ec-4853-984e-370723d96857 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:44.433887 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ca82e1ea-c6ec-4853-984e-370723d96857 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1501 microversion: 2.1 time: 0.246832 May 27 15:17:44.434811 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 225/428] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:44 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1501 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:44.452182 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8a485150-8d64-4d80-83f0-1e77aaf67c67 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61ad4d24-fb78-429d-ab5f-7ebd5590fe8c"}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:44.453306 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-8a485150-8d64-4d80-83f0-1e77aaf67c67 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:44.460073 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8a485150-8d64-4d80-83f0-1e77aaf67c67 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:44.460557 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8a485150-8d64-4d80-83f0-1e77aaf67c67 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:44.461326 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8a485150-8d64-4d80-83f0-1e77aaf67c67 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:44.461763 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8a485150-8d64-4d80-83f0-1e77aaf67c67 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:44.489693 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-8a485150-8d64-4d80-83f0-1e77aaf67c67 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] HTTP exception thrown: Cannot 'attach_volume' instance 5c20afff-0f88-4fdf-9394-7025ab53044a while it is in vm_state rescued May 27 15:17:44.491415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8a485150-8d64-4d80-83f0-1e77aaf67c67 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Request method failure captured: May 27 15:17:44.491415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: POST /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a/os-volume_attachments HTTP/1.1 May 27 15:17:44.491415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:17:44.491415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:17:44.491415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:17:44.491415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 74 May 27 15:17:44.491415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:17:44.491415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:17:44.491415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:17:44.491415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:17:44.491415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOsskJv0Za1_r4uQKA_pi415_6wML-p1mRVGBWD8lWuud7bzAGolysbWk-OZBZUDOlh33cVz8_cStEJa1_A3rWwn3mlg65e6M9osS70eYm9HT9aGfMK1PAt0mA1rcJnxNqZvqN2lltoyozOfD_R1N4W67Q6b0UC8RqROVyLsQCTGw-I May 27 15:17:44.491415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:17:44.491415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:17:44.491415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:17:44.491415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:17:44.491415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:17:44.491415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:17:44.491415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: c208c3d86c504ea086bf763e241cbc88 May 27 15:17:44.491415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1899191250 May 27 15:17:44.491415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:17:44.491415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:17:44.492994 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c208c3d86c504ea086bf763e241cbc88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c208c3d86c504ea086bf763e241cbc88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c208c3d86c504ea086bf763e241cbc88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c208c3d86c504ea086bf763e241cbc88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:17:44.492994 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1899191250 May 27 15:17:44.492994 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: c208c3d86c504ea086bf763e241cbc88 May 27 15:17:44.492994 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1899191250 May 27 15:17:44.492994 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-ServerRescueNegativeTestJSON-1899191250-project May 27 15:17:44.492994 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:17:44.492994 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:17:44.492994 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 9c9149cb2b3c423796164b487a305bbd May 27 15:17:44.492994 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1899191250-project May 27 15:17:44.492994 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: May 27 15:17:44.492994 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {"volumeAttachment": {"volumeId": "61ad4d24-fb78-429d-ab5f-7ebd5590fe8c"}} May 27 15:17:44.492994 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:17:44.493897 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Cannot 'attach_volume' instance 5c20afff-0f88-4fdf-9394-7025ab53044a while it is in vm_state rescued May 27 15:17:44.493897 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'server_id': '5c20afff-0f88-4fdf-9394-7025ab53044a', 'body': {'volumeAttachment': {'volumeId': '61ad4d24-fb78-429d-ab5f-7ebd5590fe8c'}}} May 27 15:17:44.493897 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:17:44.493897 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:44.493897 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 15:17:44.493897 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 15:17:44.493897 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:17:44.493897 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:17:44.493897 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 15:17:44.493897 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 15:17:44.493897 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5c20afff-0f88-4fdf-9394-7025ab53044a in vm_state rescued. Cannot attach_volume while the instance is in this state. May 27 15:17:44.493897 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:17:44.493897 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:44.493897 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:17:44.493897 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:44.493897 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:44.493897 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:44.493897 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:17:44.493897 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:17:44.495351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:17:44.495351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:17:44.495351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:17:44.495351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:17:44.495351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:17:44.495351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:17:44.495351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:17:44.495351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:17:44.495351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 27 15:17:44.495351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 15:17:44.495351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 15:17:44.495351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 15:17:44.495351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5c20afff-0f88-4fdf-9394-7025ab53044a while it is in vm_state rescued May 27 15:17:44.495351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:17:44.495351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:17:44.495351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:17:44.495351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:17:44.495351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:17:44.495351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:17:44.496657 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:17:44.496657 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:17:44.496657 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5c20afff-0f88-4fdf-9394-7025ab53044a while it is in vm_state rescued May 27 15:17:44.496657 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:17:44.496657 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8a485150-8d64-4d80-83f0-1e77aaf67c67 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Returning 409 to user: Cannot 'attach_volume' instance 5c20afff-0f88-4fdf-9394-7025ab53044a while it is in vm_state rescued {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:17:44.496657 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-8a485150-8d64-4d80-83f0-1e77aaf67c67 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "POST /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044944 May 27 15:17:44.496657 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 226/429] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 15:17:44 2022] POST /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 15:17:44.502239 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-01d95607-eb7c-4f16-9e1f-f4e807c0ec51 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:44.502771 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-01d95607-eb7c-4f16-9e1f-f4e807c0ec51 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:44.508917 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-01d95607-eb7c-4f16-9e1f-f4e807c0ec51 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:44.509396 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-01d95607-eb7c-4f16-9e1f-f4e807c0ec51 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:44.510533 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-01d95607-eb7c-4f16-9e1f-f4e807c0ec51 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:44.511007 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-01d95607-eb7c-4f16-9e1f-f4e807c0ec51 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:44.569196 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a1574099-5105-4803-88b9-6aa78434b9f9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:44.578390 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a1574099-5105-4803-88b9-6aa78434b9f9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:44.579909 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a1574099-5105-4803-88b9-6aa78434b9f9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:44.581873 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a1574099-5105-4803-88b9-6aa78434b9f9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.178770 May 27 15:17:44.582492 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 204/430] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:44 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:17:44.583261 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-01d95607-eb7c-4f16-9e1f-f4e807c0ec51 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "POST /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a/action" status: 202 len: 0 microversion: 2.1 time: 0.084476 May 27 15:17:44.586980 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 227/431] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 15:17:44 2022] POST /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:17:44.592796 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-fc9a1598-7757-4023-a99d-b7a047a2e77c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:44.593736 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-fc9a1598-7757-4023-a99d-b7a047a2e77c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:44.599705 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fc9a1598-7757-4023-a99d-b7a047a2e77c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:44.600159 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fc9a1598-7757-4023-a99d-b7a047a2e77c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:44.601074 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fc9a1598-7757-4023-a99d-b7a047a2e77c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:44.601074 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fc9a1598-7757-4023-a99d-b7a047a2e77c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:44.734240 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-fc9a1598-7757-4023-a99d-b7a047a2e77c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:44.741876 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-fc9a1598-7757-4023-a99d-b7a047a2e77c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1509 microversion: 2.1 time: 0.152905 May 27 15:17:44.742486 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 205/432] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:44 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:45.601886 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-6d93b9b0-5d13-4538-b973-bb3b73707d4b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:45.602573 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-6d93b9b0-5d13-4538-b973-bb3b73707d4b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:45.609050 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6d93b9b0-5d13-4538-b973-bb3b73707d4b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:45.609494 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6d93b9b0-5d13-4538-b973-bb3b73707d4b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:45.610249 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6d93b9b0-5d13-4538-b973-bb3b73707d4b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:45.610683 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6d93b9b0-5d13-4538-b973-bb3b73707d4b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:45.746479 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6d93b9b0-5d13-4538-b973-bb3b73707d4b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:45.755574 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6d93b9b0-5d13-4538-b973-bb3b73707d4b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:45.757083 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6d93b9b0-5d13-4538-b973-bb3b73707d4b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:45.758235 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-6d93b9b0-5d13-4538-b973-bb3b73707d4b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.161227 May 27 15:17:45.758794 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 228/433] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:45 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:45.767335 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-0c06e2ae-49c8-41ca-b220-816ca4845f75 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:45.768176 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-0c06e2ae-49c8-41ca-b220-816ca4845f75 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:45.775725 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0c06e2ae-49c8-41ca-b220-816ca4845f75 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:45.776291 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0c06e2ae-49c8-41ca-b220-816ca4845f75 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:45.777066 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0c06e2ae-49c8-41ca-b220-816ca4845f75 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:45.777531 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0c06e2ae-49c8-41ca-b220-816ca4845f75 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:45.922826 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-0c06e2ae-49c8-41ca-b220-816ca4845f75 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:45.930223 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-0c06e2ae-49c8-41ca-b220-816ca4845f75 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1509 microversion: 2.1 time: 0.174441 May 27 15:17:45.931594 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 206/434] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:45 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:46.778653 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-5f9e02b1-3718-4b2a-be90-db5f7dd65689 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:46.780195 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-5f9e02b1-3718-4b2a-be90-db5f7dd65689 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:46.791496 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5f9e02b1-3718-4b2a-be90-db5f7dd65689 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:46.792264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5f9e02b1-3718-4b2a-be90-db5f7dd65689 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:46.793346 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5f9e02b1-3718-4b2a-be90-db5f7dd65689 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:46.793977 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5f9e02b1-3718-4b2a-be90-db5f7dd65689 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:46.952527 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-ec7bf06b-54ee-47e5-8994-733c76be3970 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:46.953547 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-ec7bf06b-54ee-47e5-8994-733c76be3970 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:46.965417 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5f9e02b1-3718-4b2a-be90-db5f7dd65689 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:46.967776 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ec7bf06b-54ee-47e5-8994-733c76be3970 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:46.968751 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ec7bf06b-54ee-47e5-8994-733c76be3970 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:46.970427 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ec7bf06b-54ee-47e5-8994-733c76be3970 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:46.971142 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ec7bf06b-54ee-47e5-8994-733c76be3970 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:46.974817 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5f9e02b1-3718-4b2a-be90-db5f7dd65689 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:46.976389 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5f9e02b1-3718-4b2a-be90-db5f7dd65689 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:46.978886 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-5f9e02b1-3718-4b2a-be90-db5f7dd65689 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.204174 May 27 15:17:46.978886 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 229/435] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:46 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:47.137209 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-ec7bf06b-54ee-47e5-8994-733c76be3970 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:47.139577 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=100 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:47.146861 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-ec7bf06b-54ee-47e5-8994-733c76be3970 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1509 microversion: 2.1 time: 0.202086 May 27 15:17:47.148224 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 207/436] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:46 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:47.997122 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-a7f2003a-4a13-4c28-920d-a9ca5fc5a1e7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:47.997728 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-a7f2003a-4a13-4c28-920d-a9ca5fc5a1e7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:48.003800 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a7f2003a-4a13-4c28-920d-a9ca5fc5a1e7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:48.004249 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a7f2003a-4a13-4c28-920d-a9ca5fc5a1e7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:48.005006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a7f2003a-4a13-4c28-920d-a9ca5fc5a1e7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:48.005441 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a7f2003a-4a13-4c28-920d-a9ca5fc5a1e7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:48.134617 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-a7f2003a-4a13-4c28-920d-a9ca5fc5a1e7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:48.143240 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-a7f2003a-4a13-4c28-920d-a9ca5fc5a1e7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:48.144838 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-a7f2003a-4a13-4c28-920d-a9ca5fc5a1e7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:48.146052 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-a7f2003a-4a13-4c28-920d-a9ca5fc5a1e7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.153556 May 27 15:17:48.146582 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 230/437] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:47 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:48.165280 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f8719676-68ed-4ff8-ae6a-db773eb6b092 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:48.166611 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-f8719676-68ed-4ff8-ae6a-db773eb6b092 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:48.173148 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f8719676-68ed-4ff8-ae6a-db773eb6b092 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:48.173596 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f8719676-68ed-4ff8-ae6a-db773eb6b092 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:48.174355 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f8719676-68ed-4ff8-ae6a-db773eb6b092 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:48.174795 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f8719676-68ed-4ff8-ae6a-db773eb6b092 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:48.306994 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f8719676-68ed-4ff8-ae6a-db773eb6b092 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:48.314412 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-f8719676-68ed-4ff8-ae6a-db773eb6b092 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1509 microversion: 2.1 time: 0.153094 May 27 15:17:48.315009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 208/438] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:48 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:49.164724 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b0e68f29-b73a-4519-9f56-088600cf6e91 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:49.165812 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b0e68f29-b73a-4519-9f56-088600cf6e91 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:49.172416 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b0e68f29-b73a-4519-9f56-088600cf6e91 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:49.172943 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b0e68f29-b73a-4519-9f56-088600cf6e91 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:49.173781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b0e68f29-b73a-4519-9f56-088600cf6e91 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:49.174215 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b0e68f29-b73a-4519-9f56-088600cf6e91 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:49.304087 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b0e68f29-b73a-4519-9f56-088600cf6e91 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:49.313214 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b0e68f29-b73a-4519-9f56-088600cf6e91 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:49.314813 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b0e68f29-b73a-4519-9f56-088600cf6e91 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:49.316176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b0e68f29-b73a-4519-9f56-088600cf6e91 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.155341 May 27 15:17:49.316759 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 231/439] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:49 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:49.331383 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-ec4cc945-311d-4fd5-b680-8bad1bc6fb6d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:49.331993 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-ec4cc945-311d-4fd5-b680-8bad1bc6fb6d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:49.339615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ec4cc945-311d-4fd5-b680-8bad1bc6fb6d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:49.340068 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ec4cc945-311d-4fd5-b680-8bad1bc6fb6d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:49.340837 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ec4cc945-311d-4fd5-b680-8bad1bc6fb6d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:49.341281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ec4cc945-311d-4fd5-b680-8bad1bc6fb6d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:49.474272 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-ec4cc945-311d-4fd5-b680-8bad1bc6fb6d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:49.483547 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-ec4cc945-311d-4fd5-b680-8bad1bc6fb6d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1509 microversion: 2.1 time: 0.155857 May 27 15:17:49.484317 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 209/440] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:49 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:50.335096 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-a115dc60-2a8a-454d-a7b0-db7d791595df tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:50.335611 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-a115dc60-2a8a-454d-a7b0-db7d791595df tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:50.342631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a115dc60-2a8a-454d-a7b0-db7d791595df tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:50.343107 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a115dc60-2a8a-454d-a7b0-db7d791595df tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:50.344126 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a115dc60-2a8a-454d-a7b0-db7d791595df tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:50.344557 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a115dc60-2a8a-454d-a7b0-db7d791595df tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:50.473155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-a115dc60-2a8a-454d-a7b0-db7d791595df tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:50.482113 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-a115dc60-2a8a-454d-a7b0-db7d791595df tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:50.483656 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-a115dc60-2a8a-454d-a7b0-db7d791595df tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:50.484814 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-a115dc60-2a8a-454d-a7b0-db7d791595df tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.153785 May 27 15:17:50.485403 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 232/441] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:50 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:50.500739 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-5a332cd8-6ebb-4944-bc16-912b90aa0ad8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:50.501339 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-5a332cd8-6ebb-4944-bc16-912b90aa0ad8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:50.507603 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5a332cd8-6ebb-4944-bc16-912b90aa0ad8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:50.508054 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5a332cd8-6ebb-4944-bc16-912b90aa0ad8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:50.508822 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5a332cd8-6ebb-4944-bc16-912b90aa0ad8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:50.509402 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5a332cd8-6ebb-4944-bc16-912b90aa0ad8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:50.646808 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-5a332cd8-6ebb-4944-bc16-912b90aa0ad8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:50.656194 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-5a332cd8-6ebb-4944-bc16-912b90aa0ad8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1509 microversion: 2.1 time: 0.159112 May 27 15:17:50.660880 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 210/442] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:50 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:51.503219 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-26b20edf-4813-4516-924a-7b8a34d63799 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:51.503762 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-26b20edf-4813-4516-924a-7b8a34d63799 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:51.510115 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-26b20edf-4813-4516-924a-7b8a34d63799 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:51.510768 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-26b20edf-4813-4516-924a-7b8a34d63799 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:51.511668 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-26b20edf-4813-4516-924a-7b8a34d63799 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:51.512093 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-26b20edf-4813-4516-924a-7b8a34d63799 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:51.652591 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-26b20edf-4813-4516-924a-7b8a34d63799 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:51.663128 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-26b20edf-4813-4516-924a-7b8a34d63799 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:51.664721 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-26b20edf-4813-4516-924a-7b8a34d63799 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:51.665991 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-26b20edf-4813-4516-924a-7b8a34d63799 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.166808 May 27 15:17:51.667175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 233/443] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:51 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:51.674570 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-925968d0-daff-48d1-b4f1-4321a30e282e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:51.675231 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-925968d0-daff-48d1-b4f1-4321a30e282e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:51.681735 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-925968d0-daff-48d1-b4f1-4321a30e282e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:51.683019 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-925968d0-daff-48d1-b4f1-4321a30e282e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:51.684079 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-925968d0-daff-48d1-b4f1-4321a30e282e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:51.684541 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-925968d0-daff-48d1-b4f1-4321a30e282e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:51.818379 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-925968d0-daff-48d1-b4f1-4321a30e282e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:51.826597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-925968d0-daff-48d1-b4f1-4321a30e282e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1509 microversion: 2.1 time: 0.156025 May 27 15:17:51.827262 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 211/444] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:51 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:17:52.687045 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-4b1870ad-f2cf-475c-b83c-1b3d1f11aa5d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:52.688318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-4b1870ad-f2cf-475c-b83c-1b3d1f11aa5d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:52.695956 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4b1870ad-f2cf-475c-b83c-1b3d1f11aa5d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:52.696646 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4b1870ad-f2cf-475c-b83c-1b3d1f11aa5d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:52.697418 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4b1870ad-f2cf-475c-b83c-1b3d1f11aa5d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:52.698421 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4b1870ad-f2cf-475c-b83c-1b3d1f11aa5d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:52.835681 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-4b1870ad-f2cf-475c-b83c-1b3d1f11aa5d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:52.843841 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-38021063-8846-4140-87bc-da37ecce8fbb tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:52.845044 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-38021063-8846-4140-87bc-da37ecce8fbb tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:52.855882 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-4b1870ad-f2cf-475c-b83c-1b3d1f11aa5d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:52.856216 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-38021063-8846-4140-87bc-da37ecce8fbb tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:52.856829 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-38021063-8846-4140-87bc-da37ecce8fbb tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:52.857411 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-4b1870ad-f2cf-475c-b83c-1b3d1f11aa5d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:52.857602 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-38021063-8846-4140-87bc-da37ecce8fbb tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:52.858196 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-38021063-8846-4140-87bc-da37ecce8fbb tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:52.858590 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-4b1870ad-f2cf-475c-b83c-1b3d1f11aa5d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.177618 May 27 15:17:52.859183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 234/445] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:52 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:52.995703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-38021063-8846-4140-87bc-da37ecce8fbb tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:53.004052 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-38021063-8846-4140-87bc-da37ecce8fbb tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1515 microversion: 2.1 time: 0.164152 May 27 15:17:53.004733 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 212/446] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:52 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:53.877693 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-0c614c4a-7480-438c-9177-edea2b77f307 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:53.878291 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-0c614c4a-7480-438c-9177-edea2b77f307 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:53.885814 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0c614c4a-7480-438c-9177-edea2b77f307 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:53.886265 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0c614c4a-7480-438c-9177-edea2b77f307 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:53.887152 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0c614c4a-7480-438c-9177-edea2b77f307 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:53.887589 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0c614c4a-7480-438c-9177-edea2b77f307 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:54.033916 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-0c614c4a-7480-438c-9177-edea2b77f307 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:54.036381 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:17:54.065464 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-0c614c4a-7480-438c-9177-edea2b77f307 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:54.070537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-0c614c4a-7480-438c-9177-edea2b77f307 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:54.071880 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-0c614c4a-7480-438c-9177-edea2b77f307 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.198678 May 27 15:17:54.086888 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 235/447] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:53 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:54.416887 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-7912b79c-359f-4b6a-8c40-7a1e0a4ac8e1 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Action: 'create', calling method: .version_select at 0x7f57e2114040>, body: {"keypair": {"name": "tempest-keypair-1584833569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGR2ExY777nDsmiLyzIZwlE1yrtBMCqJ4ZOz6YlwTP+UdKzjotVMupn7ouLt8kth0O6kvbroEbs+G3cnufJtiimOvRV2trwq5gjXn+ts0pnc3XAAjlcnz6Pagur8GHQ/MQ=="}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:54.440946 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-7912b79c-359f-4b6a-8c40-7a1e0a4ac8e1 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Getting quotas for project c208c3d86c504ea086bf763e241cbc88. Resources: {'key_pairs'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:17:54.446367 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-7912b79c-359f-4b6a-8c40-7a1e0a4ac8e1 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Getting quotas for user 9c9149cb2b3c423796164b487a305bbd and project c208c3d86c504ea086bf763e241cbc88. Resources: {'key_pairs'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:17:54.523283 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-7912b79c-359f-4b6a-8c40-7a1e0a4ac8e1 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.120557 May 27 15:17:54.523885 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 213/448] 10.222.0.50 () {60 vars in 1158 bytes} [Fri May 27 15:17:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:17:55.097554 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-3159b55e-c36c-453a-8be4-a7e69ef880d1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:55.099121 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-3159b55e-c36c-453a-8be4-a7e69ef880d1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:55.119989 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3159b55e-c36c-453a-8be4-a7e69ef880d1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:55.121081 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3159b55e-c36c-453a-8be4-a7e69ef880d1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:55.122404 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3159b55e-c36c-453a-8be4-a7e69ef880d1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:55.124022 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3159b55e-c36c-453a-8be4-a7e69ef880d1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:55.381474 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-3159b55e-c36c-453a-8be4-a7e69ef880d1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:55.394269 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-3159b55e-c36c-453a-8be4-a7e69ef880d1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:55.396476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-3159b55e-c36c-453a-8be4-a7e69ef880d1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:55.397913 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-3159b55e-c36c-453a-8be4-a7e69ef880d1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.306094 May 27 15:17:55.398718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 236/449] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:55 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:56.418715 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-99ea4edb-1638-4bd3-a1da-9a8a32048f65 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:56.419410 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-99ea4edb-1638-4bd3-a1da-9a8a32048f65 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:56.419527 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-8eaea042-814c-42f2-ba75-23680fa89cff tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-655150830", "imageRef": "a9407644-1f68-43e6-beb1-ce2085766180", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d9b2e84-aea6-4097-b9c0-5d1bab177a20"}], "security_groups": [{"name": "tempest-securitygroup--1946721032"}], "key_name": "tempest-keypair-1584833569", "user_data": "}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:17:56.426175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-99ea4edb-1638-4bd3-a1da-9a8a32048f65 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:56.426651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-99ea4edb-1638-4bd3-a1da-9a8a32048f65 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:56.427685 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-99ea4edb-1638-4bd3-a1da-9a8a32048f65 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:56.428249 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-99ea4edb-1638-4bd3-a1da-9a8a32048f65 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:56.589674 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-99ea4edb-1638-4bd3-a1da-9a8a32048f65 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:56.601106 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-99ea4edb-1638-4bd3-a1da-9a8a32048f65 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:56.605519 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-99ea4edb-1638-4bd3-a1da-9a8a32048f65 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:56.606900 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-99ea4edb-1638-4bd3-a1da-9a8a32048f65 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.192772 May 27 15:17:56.607555 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 237/450] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:56 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:17:57.626459 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-61f86da1-9fd9-4731-9985-895284300d6f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:57.627141 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-61f86da1-9fd9-4731-9985-895284300d6f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:57.633843 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-61f86da1-9fd9-4731-9985-895284300d6f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:57.634384 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-61f86da1-9fd9-4731-9985-895284300d6f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:57.635301 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-61f86da1-9fd9-4731-9985-895284300d6f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:57.635744 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-61f86da1-9fd9-4731-9985-895284300d6f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:57.802046 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-61f86da1-9fd9-4731-9985-895284300d6f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:57.830908 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-61f86da1-9fd9-4731-9985-895284300d6f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:57.832513 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-61f86da1-9fd9-4731-9985-895284300d6f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:57.833722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-61f86da1-9fd9-4731-9985-895284300d6f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.211372 May 27 15:17:57.834286 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 238/451] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:57 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:17:58.368692 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.network.neutron [None req-8eaea042-814c-42f2-ba75-23680fa89cff tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] validate_networks() for [('0d9b2e84-aea6-4097-b9c0-5d1bab177a20', None, None, None, None, None)] {{(pid=117743) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:17:58.805458 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-8eaea042-814c-42f2-ba75-23680fa89cff tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Flavor limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:17:58.805890 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-8eaea042-814c-42f2-ba75-23680fa89cff tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Image limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:17:58.806546 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-8eaea042-814c-42f2-ba75-23680fa89cff tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Flavor pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:17:58.807703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-8eaea042-814c-42f2-ba75-23680fa89cff tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Image pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:17:58.808496 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-8eaea042-814c-42f2-ba75-23680fa89cff tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:17:58.818176 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8eaea042-814c-42f2-ba75-23680fa89cff tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:58.818764 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8eaea042-814c-42f2-ba75-23680fa89cff tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:58.819607 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8eaea042-814c-42f2-ba75-23680fa89cff tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:58.819897 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8eaea042-814c-42f2-ba75-23680fa89cff tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:58.842406 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-8eaea042-814c-42f2-ba75-23680fa89cff tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Getting quotas for project c208c3d86c504ea086bf763e241cbc88. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:17:58.847571 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-8eaea042-814c-42f2-ba75-23680fa89cff tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Getting quotas for user 9c9149cb2b3c423796164b487a305bbd and project c208c3d86c504ea086bf763e241cbc88. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:17:58.852890 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-c61b1b0c-a103-4ad5-a22e-dc6bd7ef8dd6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:58.854731 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-c61b1b0c-a103-4ad5-a22e-dc6bd7ef8dd6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:58.860545 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-8eaea042-814c-42f2-ba75-23680fa89cff tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Going to run 1 instances... {{(pid=117743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:17:58.861795 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c61b1b0c-a103-4ad5-a22e-dc6bd7ef8dd6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:58.862240 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c61b1b0c-a103-4ad5-a22e-dc6bd7ef8dd6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:58.863035 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c61b1b0c-a103-4ad5-a22e-dc6bd7ef8dd6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:17:58.863468 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c61b1b0c-a103-4ad5-a22e-dc6bd7ef8dd6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:17:58.864002 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-8eaea042-814c-42f2-ba75-23680fa89cff tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9407644-1f68-43e6-beb1-ce2085766180',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:17:58.919465 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-8eaea042-814c-42f2-ba75-23680fa89cff tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.505139 May 27 15:17:58.920851 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 214/452] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 15:17:56 2022] POST /compute/v2.1/servers => generated 409 bytes in 2507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:17:58.933886 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-cd8fe436-4bd8-4a6f-ba6e-c9fc76b73d64 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:17:58.934960 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-cd8fe436-4bd8-4a6f-ba6e-c9fc76b73d64 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:17:59.098153 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-cd8fe436-4bd8-4a6f-ba6e-c9fc76b73d64 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:59.114902 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-cd8fe436-4bd8-4a6f-ba6e-c9fc76b73d64 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1245 microversion: 2.1 time: 0.188028 May 27 15:17:59.116346 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 215/453] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:17:58 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1245 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:17:59.236910 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-c61b1b0c-a103-4ad5-a22e-dc6bd7ef8dd6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:59.257594 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-c61b1b0c-a103-4ad5-a22e-dc6bd7ef8dd6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:59.263695 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-c61b1b0c-a103-4ad5-a22e-dc6bd7ef8dd6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:17:59.267042 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-c61b1b0c-a103-4ad5-a22e-dc6bd7ef8dd6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.417577 May 27 15:17:59.270452 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 239/454] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:17:58 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:18:00.135993 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-fba450a4-ddec-41a6-9238-a4794dcd9153 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:00.136551 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-fba450a4-ddec-41a6-9238-a4794dcd9153 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:00.155372 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fba450a4-ddec-41a6-9238-a4794dcd9153 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:00.155812 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fba450a4-ddec-41a6-9238-a4794dcd9153 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:00.156604 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fba450a4-ddec-41a6-9238-a4794dcd9153 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:00.157042 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fba450a4-ddec-41a6-9238-a4794dcd9153 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:00.230138 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-fba450a4-ddec-41a6-9238-a4794dcd9153 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:00.240534 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-fba450a4-ddec-41a6-9238-a4794dcd9153 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1249 microversion: 2.1 time: 0.109160 May 27 15:18:00.256166 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 216/455] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:00 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1249 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:00.289016 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-3346ed0a-518f-40d8-84d8-f45753770df7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:00.290237 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-3346ed0a-518f-40d8-84d8-f45753770df7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:00.299229 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3346ed0a-518f-40d8-84d8-f45753770df7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:00.299941 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3346ed0a-518f-40d8-84d8-f45753770df7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:00.300731 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3346ed0a-518f-40d8-84d8-f45753770df7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:00.301341 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3346ed0a-518f-40d8-84d8-f45753770df7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:00.445081 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-3346ed0a-518f-40d8-84d8-f45753770df7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:00.453398 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-3346ed0a-518f-40d8-84d8-f45753770df7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:00.454946 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-3346ed0a-518f-40d8-84d8-f45753770df7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:00.456104 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-3346ed0a-518f-40d8-84d8-f45753770df7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.171524 May 27 15:18:00.456662 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 240/456] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:18:00 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:01.273934 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-bf8f23c6-d5d3-435b-bd88-581779c6ddf2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:01.275313 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-bf8f23c6-d5d3-435b-bd88-581779c6ddf2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:01.283866 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bf8f23c6-d5d3-435b-bd88-581779c6ddf2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:01.284323 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bf8f23c6-d5d3-435b-bd88-581779c6ddf2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:01.285186 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bf8f23c6-d5d3-435b-bd88-581779c6ddf2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:01.285531 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bf8f23c6-d5d3-435b-bd88-581779c6ddf2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:01.352648 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-bf8f23c6-d5d3-435b-bd88-581779c6ddf2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:01.360361 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-bf8f23c6-d5d3-435b-bd88-581779c6ddf2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1249 microversion: 2.1 time: 0.090714 May 27 15:18:01.360932 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 217/457] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:01 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1249 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:01.475220 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-5b844aa4-5a35-491b-99d0-31fce9677b9f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:01.475779 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-5b844aa4-5a35-491b-99d0-31fce9677b9f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:01.482475 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5b844aa4-5a35-491b-99d0-31fce9677b9f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:01.482955 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5b844aa4-5a35-491b-99d0-31fce9677b9f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:01.483782 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5b844aa4-5a35-491b-99d0-31fce9677b9f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:01.484280 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5b844aa4-5a35-491b-99d0-31fce9677b9f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:01.635952 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5b844aa4-5a35-491b-99d0-31fce9677b9f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:01.646115 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5b844aa4-5a35-491b-99d0-31fce9677b9f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:01.648613 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5b844aa4-5a35-491b-99d0-31fce9677b9f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:01.649894 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-5b844aa4-5a35-491b-99d0-31fce9677b9f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.178727 May 27 15:18:01.650576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 241/458] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:18:01 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:02.376441 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-c291889c-ead5-4608-b316-435af6be8414 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:02.377050 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-c291889c-ead5-4608-b316-435af6be8414 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:02.383657 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c291889c-ead5-4608-b316-435af6be8414 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:02.384112 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c291889c-ead5-4608-b316-435af6be8414 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:02.384919 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c291889c-ead5-4608-b316-435af6be8414 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:02.385357 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c291889c-ead5-4608-b316-435af6be8414 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:02.450548 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-c291889c-ead5-4608-b316-435af6be8414 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:02.461794 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-c291889c-ead5-4608-b316-435af6be8414 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1249 microversion: 2.1 time: 0.088254 May 27 15:18:02.461794 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 218/459] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:02 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:02.669020 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-af670662-1a9e-49ae-bdf4-b4153422fc28 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:02.669664 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-af670662-1a9e-49ae-bdf4-b4153422fc28 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:02.676103 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-af670662-1a9e-49ae-bdf4-b4153422fc28 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:02.676550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-af670662-1a9e-49ae-bdf4-b4153422fc28 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:02.677313 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-af670662-1a9e-49ae-bdf4-b4153422fc28 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:02.677752 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-af670662-1a9e-49ae-bdf4-b4153422fc28 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:02.809551 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-af670662-1a9e-49ae-bdf4-b4153422fc28 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:02.817814 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-af670662-1a9e-49ae-bdf4-b4153422fc28 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:02.819340 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-af670662-1a9e-49ae-bdf4-b4153422fc28 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:02.820572 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-af670662-1a9e-49ae-bdf4-b4153422fc28 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.155679 May 27 15:18:02.821134 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 242/460] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:18:02 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:03.479145 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-088f2882-db06-4b3c-8866-492b969eacf1 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:03.479972 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-088f2882-db06-4b3c-8866-492b969eacf1 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:03.486912 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-088f2882-db06-4b3c-8866-492b969eacf1 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:03.487475 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-088f2882-db06-4b3c-8866-492b969eacf1 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:03.488162 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-088f2882-db06-4b3c-8866-492b969eacf1 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:03.488602 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-088f2882-db06-4b3c-8866-492b969eacf1 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:03.553676 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-088f2882-db06-4b3c-8866-492b969eacf1 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:03.561722 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-088f2882-db06-4b3c-8866-492b969eacf1 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1241 microversion: 2.1 time: 0.086980 May 27 15:18:03.562297 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 219/461] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:03 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:03.842585 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-293984d4-e6da-431a-8f9a-07b1e01ade9c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:03.843225 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-293984d4-e6da-431a-8f9a-07b1e01ade9c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:03.849797 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-293984d4-e6da-431a-8f9a-07b1e01ade9c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:03.850240 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-293984d4-e6da-431a-8f9a-07b1e01ade9c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:03.851017 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-293984d4-e6da-431a-8f9a-07b1e01ade9c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:03.851448 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-293984d4-e6da-431a-8f9a-07b1e01ade9c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:03.990117 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-293984d4-e6da-431a-8f9a-07b1e01ade9c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:03.999308 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-293984d4-e6da-431a-8f9a-07b1e01ade9c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:04.001171 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-293984d4-e6da-431a-8f9a-07b1e01ade9c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:04.002628 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-293984d4-e6da-431a-8f9a-07b1e01ade9c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.164886 May 27 15:18:04.003339 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 243/462] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:18:03 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:04.578777 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-5df7f424-007a-469f-8e6b-c963d835a366 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:04.579411 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-5df7f424-007a-469f-8e6b-c963d835a366 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:04.586037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5df7f424-007a-469f-8e6b-c963d835a366 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:04.586490 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5df7f424-007a-469f-8e6b-c963d835a366 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:04.587286 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5df7f424-007a-469f-8e6b-c963d835a366 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:04.587722 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5df7f424-007a-469f-8e6b-c963d835a366 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:04.649831 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-5df7f424-007a-469f-8e6b-c963d835a366 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:04.657775 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-5df7f424-007a-469f-8e6b-c963d835a366 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1297 microversion: 2.1 time: 0.082839 May 27 15:18:04.658341 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 220/463] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:04 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1297 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:05.021072 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-37fe76e1-6a75-41d2-8ec5-949aaa4f6bed tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:05.021676 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-37fe76e1-6a75-41d2-8ec5-949aaa4f6bed tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:05.029323 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-37fe76e1-6a75-41d2-8ec5-949aaa4f6bed tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:05.029804 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-37fe76e1-6a75-41d2-8ec5-949aaa4f6bed tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:05.030697 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-37fe76e1-6a75-41d2-8ec5-949aaa4f6bed tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:05.031350 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-37fe76e1-6a75-41d2-8ec5-949aaa4f6bed tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:05.188080 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-37fe76e1-6a75-41d2-8ec5-949aaa4f6bed tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:05.197632 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-37fe76e1-6a75-41d2-8ec5-949aaa4f6bed tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:05.199793 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-37fe76e1-6a75-41d2-8ec5-949aaa4f6bed tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:05.201125 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-37fe76e1-6a75-41d2-8ec5-949aaa4f6bed tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.183959 May 27 15:18:05.201696 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 244/464] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:18:05 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:05.677506 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-41212dbf-0c5a-4766-b3bf-c3977b49a581 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:05.678709 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-41212dbf-0c5a-4766-b3bf-c3977b49a581 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:05.688762 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-41212dbf-0c5a-4766-b3bf-c3977b49a581 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:05.689215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-41212dbf-0c5a-4766-b3bf-c3977b49a581 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:05.690086 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-41212dbf-0c5a-4766-b3bf-c3977b49a581 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:05.690517 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-41212dbf-0c5a-4766-b3bf-c3977b49a581 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:05.787184 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-41212dbf-0c5a-4766-b3bf-c3977b49a581 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:05.799290 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-41212dbf-0c5a-4766-b3bf-c3977b49a581 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1303 microversion: 2.1 time: 0.124917 May 27 15:18:05.800872 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 221/465] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:05 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1303 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:06.221015 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-22b79ead-a698-41ca-a563-aa48df9c062f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:06.221459 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-22b79ead-a698-41ca-a563-aa48df9c062f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:06.228506 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-22b79ead-a698-41ca-a563-aa48df9c062f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:06.230037 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-22b79ead-a698-41ca-a563-aa48df9c062f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:06.231348 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-22b79ead-a698-41ca-a563-aa48df9c062f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:06.232091 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-22b79ead-a698-41ca-a563-aa48df9c062f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:06.648702 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-22b79ead-a698-41ca-a563-aa48df9c062f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:06.658583 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-22b79ead-a698-41ca-a563-aa48df9c062f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:06.660309 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-22b79ead-a698-41ca-a563-aa48df9c062f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:06.661821 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-22b79ead-a698-41ca-a563-aa48df9c062f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.445749 May 27 15:18:06.662492 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 245/466] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:18:06 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:06.821084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-55598afb-36bd-44c2-893f-e404fa43b733 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:06.823825 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-55598afb-36bd-44c2-893f-e404fa43b733 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:06.844850 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-55598afb-36bd-44c2-893f-e404fa43b733 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:06.846736 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-55598afb-36bd-44c2-893f-e404fa43b733 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:06.847672 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-55598afb-36bd-44c2-893f-e404fa43b733 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:06.848268 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-55598afb-36bd-44c2-893f-e404fa43b733 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:07.091266 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-38250976-169c-495c-8b7f-2cfe22c29572 req-462a301d-3ece-43b4-ab2b-37a8bd314201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b91f595-1d49-4eed-8d8c-57bb287d34b5", "tag": "912582f8-c57d-4774-8d6c-0a14883de730"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:07.102049 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-38250976-169c-495c-8b7f-2cfe22c29572 req-462a301d-3ece-43b4-ab2b-37a8bd314201 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:07.102705 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-38250976-169c-495c-8b7f-2cfe22c29572 req-462a301d-3ece-43b4-ab2b-37a8bd314201 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:07.110473 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-55598afb-36bd-44c2-893f-e404fa43b733 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:07.116506 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-38250976-169c-495c-8b7f-2cfe22c29572 req-462a301d-3ece-43b4-ab2b-37a8bd314201 service nova] Creating event network-changed:912582f8-c57d-4774-8d6c-0a14883de730 for instance 5b91f595-1d49-4eed-8d8c-57bb287d34b5 on hv-cinder-84254 May 27 15:18:07.118782 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-55598afb-36bd-44c2-893f-e404fa43b733 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1371 microversion: 2.1 time: 0.304337 May 27 15:18:07.121262 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 222/467] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:06 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1371 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:07.124991 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-38250976-169c-495c-8b7f-2cfe22c29572 req-462a301d-3ece-43b4-ab2b-37a8bd314201 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040075 May 27 15:18:07.126180 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 246/468] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:07.681141 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d2c2b87d-3e11-4a58-a032-481698bfb3f0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:07.681950 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-d2c2b87d-3e11-4a58-a032-481698bfb3f0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:07.698634 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d2c2b87d-3e11-4a58-a032-481698bfb3f0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:07.699205 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d2c2b87d-3e11-4a58-a032-481698bfb3f0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:07.699905 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d2c2b87d-3e11-4a58-a032-481698bfb3f0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:07.700504 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d2c2b87d-3e11-4a58-a032-481698bfb3f0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:07.931233 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d2c2b87d-3e11-4a58-a032-481698bfb3f0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:07.943410 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d2c2b87d-3e11-4a58-a032-481698bfb3f0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:07.946013 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d2c2b87d-3e11-4a58-a032-481698bfb3f0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:07.949726 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-d2c2b87d-3e11-4a58-a032-481698bfb3f0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.272682 May 27 15:18:07.964198 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 223/469] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:18:07 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:08.139226 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-1fa5d265-589a-4175-a582-3f2b554e18b7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:08.140567 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-1fa5d265-589a-4175-a582-3f2b554e18b7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:08.142586 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=58 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:08.148173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1fa5d265-589a-4175-a582-3f2b554e18b7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:08.148660 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1fa5d265-589a-4175-a582-3f2b554e18b7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:08.149377 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1fa5d265-589a-4175-a582-3f2b554e18b7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:08.149807 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1fa5d265-589a-4175-a582-3f2b554e18b7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:08.294206 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-1fa5d265-589a-4175-a582-3f2b554e18b7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:08.306347 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-1fa5d265-589a-4175-a582-3f2b554e18b7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1371 microversion: 2.1 time: 0.171596 May 27 15:18:08.309159 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 247/470] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:08 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:08.968426 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-869f78e4-9f37-4551-a87a-b2697ef43474 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:08.969379 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-869f78e4-9f37-4551-a87a-b2697ef43474 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:08.971257 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=2 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:08.972454 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:08.985084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-869f78e4-9f37-4551-a87a-b2697ef43474 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:08.985738 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-869f78e4-9f37-4551-a87a-b2697ef43474 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:08.986711 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-869f78e4-9f37-4551-a87a-b2697ef43474 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:08.987349 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-869f78e4-9f37-4551-a87a-b2697ef43474 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:09.113095 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=12 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:09.140777 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-869f78e4-9f37-4551-a87a-b2697ef43474 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:09.149434 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-869f78e4-9f37-4551-a87a-b2697ef43474 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:09.151901 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-869f78e4-9f37-4551-a87a-b2697ef43474 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:09.153267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-869f78e4-9f37-4551-a87a-b2697ef43474 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.188807 May 27 15:18:09.153829 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 224/471] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:18:08 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:09.325387 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f6813f9c-851c-4c3e-9a30-3a4931999f22 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:09.326583 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f6813f9c-851c-4c3e-9a30-3a4931999f22 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:09.333439 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f6813f9c-851c-4c3e-9a30-3a4931999f22 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:09.334100 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f6813f9c-851c-4c3e-9a30-3a4931999f22 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:09.335089 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f6813f9c-851c-4c3e-9a30-3a4931999f22 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:09.335706 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f6813f9c-851c-4c3e-9a30-3a4931999f22 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:09.479094 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f6813f9c-851c-4c3e-9a30-3a4931999f22 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:09.488221 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f6813f9c-851c-4c3e-9a30-3a4931999f22 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1371 microversion: 2.1 time: 0.167231 May 27 15:18:09.488905 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 248/472] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:09 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:10.181033 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f7a932c0-36cc-407c-98f3-291cad296dcd tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:10.183019 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-f7a932c0-36cc-407c-98f3-291cad296dcd tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:10.191296 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f7a932c0-36cc-407c-98f3-291cad296dcd tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:10.192222 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f7a932c0-36cc-407c-98f3-291cad296dcd tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:10.193301 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f7a932c0-36cc-407c-98f3-291cad296dcd tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:10.193893 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f7a932c0-36cc-407c-98f3-291cad296dcd tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:10.461421 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f7a932c0-36cc-407c-98f3-291cad296dcd tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:10.482166 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f7a932c0-36cc-407c-98f3-291cad296dcd tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:10.491526 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f7a932c0-36cc-407c-98f3-291cad296dcd tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:10.496911 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-f7a932c0-36cc-407c-98f3-291cad296dcd tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.319826 May 27 15:18:10.506048 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-facf9937-3d53-4f6c-88da-f975b7ae405b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:10.507118 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 225/473] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:18:10 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:10.507503 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-facf9937-3d53-4f6c-88da-f975b7ae405b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:10.516846 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-facf9937-3d53-4f6c-88da-f975b7ae405b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:10.517533 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-facf9937-3d53-4f6c-88da-f975b7ae405b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:10.518315 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-facf9937-3d53-4f6c-88da-f975b7ae405b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:10.518753 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-facf9937-3d53-4f6c-88da-f975b7ae405b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:10.767505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-facf9937-3d53-4f6c-88da-f975b7ae405b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:10.783002 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-facf9937-3d53-4f6c-88da-f975b7ae405b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1371 microversion: 2.1 time: 0.280298 May 27 15:18:10.784327 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 249/474] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:10 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1371 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:11.521120 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-dd6d0ad1-1868-45c9-81e0-2de5e226c50f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:11.522437 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-dd6d0ad1-1868-45c9-81e0-2de5e226c50f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:11.532421 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-dd6d0ad1-1868-45c9-81e0-2de5e226c50f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:11.533843 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-dd6d0ad1-1868-45c9-81e0-2de5e226c50f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:11.535505 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-dd6d0ad1-1868-45c9-81e0-2de5e226c50f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:11.536191 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-dd6d0ad1-1868-45c9-81e0-2de5e226c50f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:11.769879 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-dd6d0ad1-1868-45c9-81e0-2de5e226c50f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:11.780260 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-dd6d0ad1-1868-45c9-81e0-2de5e226c50f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:11.782159 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-dd6d0ad1-1868-45c9-81e0-2de5e226c50f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:11.783961 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-dd6d0ad1-1868-45c9-81e0-2de5e226c50f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.267246 May 27 15:18:11.784538 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 226/475] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:18:11 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:11.801501 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-44d8501d-6a07-4657-984a-145e2f9fefcc tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:11.802114 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-44d8501d-6a07-4657-984a-145e2f9fefcc tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:11.810155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-44d8501d-6a07-4657-984a-145e2f9fefcc tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:11.810934 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-44d8501d-6a07-4657-984a-145e2f9fefcc tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:11.811860 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-44d8501d-6a07-4657-984a-145e2f9fefcc tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:11.812447 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-44d8501d-6a07-4657-984a-145e2f9fefcc tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:11.980402 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-44d8501d-6a07-4657-984a-145e2f9fefcc tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:11.988612 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-44d8501d-6a07-4657-984a-145e2f9fefcc tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1371 microversion: 2.1 time: 0.191519 May 27 15:18:11.989203 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 250/476] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:11 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:12.614241 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-36e4284d-22e7-4a25-83d3-f62368de27ed req-2ff86100-f316-4e27-896e-13fc5128b143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b91f595-1d49-4eed-8d8c-57bb287d34b5", "name": "network-vif-plugged", "status": "completed", "tag": "912582f8-c57d-4774-8d6c-0a14883de730"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:12.641233 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-36e4284d-22e7-4a25-83d3-f62368de27ed req-2ff86100-f316-4e27-896e-13fc5128b143 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:12.643621 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-36e4284d-22e7-4a25-83d3-f62368de27ed req-2ff86100-f316-4e27-896e-13fc5128b143 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:12.660349 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=100 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:12.679715 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-36e4284d-22e7-4a25-83d3-f62368de27ed req-2ff86100-f316-4e27-896e-13fc5128b143 service nova] Creating event network-vif-plugged:912582f8-c57d-4774-8d6c-0a14883de730 for instance 5b91f595-1d49-4eed-8d8c-57bb287d34b5 on hv-cinder-84254 May 27 15:18:12.687744 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-36e4284d-22e7-4a25-83d3-f62368de27ed req-2ff86100-f316-4e27-896e-13fc5128b143 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077439 May 27 15:18:12.689491 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 227/477] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:12.803096 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b1ce1aba-5d74-4496-b9eb-34c9217936d5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:12.803908 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b1ce1aba-5d74-4496-b9eb-34c9217936d5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:12.816374 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b1ce1aba-5d74-4496-b9eb-34c9217936d5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:12.829781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b1ce1aba-5d74-4496-b9eb-34c9217936d5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:12.831404 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b1ce1aba-5d74-4496-b9eb-34c9217936d5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:12.833291 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b1ce1aba-5d74-4496-b9eb-34c9217936d5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:13.006959 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-4af19665-d82b-45ff-a918-3109fb6395ac tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:13.008940 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-4af19665-d82b-45ff-a918-3109fb6395ac tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:13.017041 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4af19665-d82b-45ff-a918-3109fb6395ac tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:13.017734 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4af19665-d82b-45ff-a918-3109fb6395ac tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:13.018829 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4af19665-d82b-45ff-a918-3109fb6395ac tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:13.019640 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4af19665-d82b-45ff-a918-3109fb6395ac tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:13.145714 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b1ce1aba-5d74-4496-b9eb-34c9217936d5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:13.177023 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b1ce1aba-5d74-4496-b9eb-34c9217936d5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:13.180282 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b1ce1aba-5d74-4496-b9eb-34c9217936d5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:13.182912 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b1ce1aba-5d74-4496-b9eb-34c9217936d5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.383871 May 27 15:18:13.183751 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 251/478] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:18:12 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:13.317623 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-4af19665-d82b-45ff-a918-3109fb6395ac tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:13.326607 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-4af19665-d82b-45ff-a918-3109fb6395ac tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1371 microversion: 2.1 time: 0.324430 May 27 15:18:13.327811 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 228/479] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:13 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1371 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:14.201784 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8ec43bde-8acd-423d-8bfc-9af79bada268 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:14.203719 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-8ec43bde-8acd-423d-8bfc-9af79bada268 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:14.215168 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8ec43bde-8acd-423d-8bfc-9af79bada268 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:14.216016 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8ec43bde-8acd-423d-8bfc-9af79bada268 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:14.217082 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8ec43bde-8acd-423d-8bfc-9af79bada268 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:14.217766 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8ec43bde-8acd-423d-8bfc-9af79bada268 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:14.349585 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d299afd6-5dfa-480e-95b7-1c45985b9419 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:14.354635 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-d299afd6-5dfa-480e-95b7-1c45985b9419 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:14.377347 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d299afd6-5dfa-480e-95b7-1c45985b9419 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:14.378434 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d299afd6-5dfa-480e-95b7-1c45985b9419 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:14.379335 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d299afd6-5dfa-480e-95b7-1c45985b9419 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:14.379890 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d299afd6-5dfa-480e-95b7-1c45985b9419 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:14.427807 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-8ec43bde-8acd-423d-8bfc-9af79bada268 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:14.441602 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-8ec43bde-8acd-423d-8bfc-9af79bada268 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:14.445732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-8ec43bde-8acd-423d-8bfc-9af79bada268 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:14.447509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-8ec43bde-8acd-423d-8bfc-9af79bada268 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.250644 May 27 15:18:14.449887 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 252/480] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:18:14 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:14.629651 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d299afd6-5dfa-480e-95b7-1c45985b9419 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:14.641577 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-d299afd6-5dfa-480e-95b7-1c45985b9419 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1371 microversion: 2.1 time: 0.300651 May 27 15:18:14.654952 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 229/481] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:14 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1371 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:15.469409 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-5b61ac2b-e4c8-4dce-840a-34b803dbbe41 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:15.470523 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-5b61ac2b-e4c8-4dce-840a-34b803dbbe41 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:15.485400 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5b61ac2b-e4c8-4dce-840a-34b803dbbe41 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:15.487464 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5b61ac2b-e4c8-4dce-840a-34b803dbbe41 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:15.490357 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5b61ac2b-e4c8-4dce-840a-34b803dbbe41 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:15.492030 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5b61ac2b-e4c8-4dce-840a-34b803dbbe41 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:15.539601 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=100 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:15.662609 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b14ab8e7-c004-41e3-8cd0-d4cdcb97d417 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:15.663861 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b14ab8e7-c004-41e3-8cd0-d4cdcb97d417 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:15.678730 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b14ab8e7-c004-41e3-8cd0-d4cdcb97d417 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:15.682156 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b14ab8e7-c004-41e3-8cd0-d4cdcb97d417 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:15.684772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b14ab8e7-c004-41e3-8cd0-d4cdcb97d417 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:15.685441 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b14ab8e7-c004-41e3-8cd0-d4cdcb97d417 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:15.736309 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5b61ac2b-e4c8-4dce-840a-34b803dbbe41 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:15.754093 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5b61ac2b-e4c8-4dce-840a-34b803dbbe41 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:15.759026 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5b61ac2b-e4c8-4dce-840a-34b803dbbe41 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:15.762458 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-5b61ac2b-e4c8-4dce-840a-34b803dbbe41 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.297720 May 27 15:18:15.764650 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 253/482] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:18:15 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:16.051439 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b14ab8e7-c004-41e3-8cd0-d4cdcb97d417 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:16.065238 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b14ab8e7-c004-41e3-8cd0-d4cdcb97d417 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1564 microversion: 2.1 time: 0.407869 May 27 15:18:16.066454 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 230/483] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:15 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1564 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:16.082398 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b4eb52ad-f883-4fa5-9b53-9b95df2a1e2c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:16.083047 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b4eb52ad-f883-4fa5-9b53-9b95df2a1e2c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:16.090284 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b4eb52ad-f883-4fa5-9b53-9b95df2a1e2c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:16.090738 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b4eb52ad-f883-4fa5-9b53-9b95df2a1e2c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:16.091553 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b4eb52ad-f883-4fa5-9b53-9b95df2a1e2c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:16.091991 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b4eb52ad-f883-4fa5-9b53-9b95df2a1e2c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:16.242722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b4eb52ad-f883-4fa5-9b53-9b95df2a1e2c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164173 May 27 15:18:16.243770 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 254/484] 10.222.0.50 () {58 vars in 1274 bytes} [Fri May 27 15:18:16 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:16.788288 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f825ee96-d155-45ce-8cc6-6fdfd01d68a0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:16.789572 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-f825ee96-d155-45ce-8cc6-6fdfd01d68a0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:16.824138 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f825ee96-d155-45ce-8cc6-6fdfd01d68a0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:16.826386 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f825ee96-d155-45ce-8cc6-6fdfd01d68a0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:16.827329 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f825ee96-d155-45ce-8cc6-6fdfd01d68a0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:16.827703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f825ee96-d155-45ce-8cc6-6fdfd01d68a0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:17.219991 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f825ee96-d155-45ce-8cc6-6fdfd01d68a0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:17.252800 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f825ee96-d155-45ce-8cc6-6fdfd01d68a0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:17.259038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f825ee96-d155-45ce-8cc6-6fdfd01d68a0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:17.263428 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-f825ee96-d155-45ce-8cc6-6fdfd01d68a0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.481367 May 27 15:18:17.264486 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 231/485] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:18:16 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:18.129800 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-94c93647-872a-47bf-8847-504390299c8a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1745920352", "imageRef": "a9407644-1f68-43e6-beb1-ce2085766180", "flavorRef": "452", "networks": [{"uuid": "684e0bf0-9400-4ba4-8588-2b0594157e55"}]}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:18.261260 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.network.neutron [None req-94c93647-872a-47bf-8847-504390299c8a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] validate_networks() for [('684e0bf0-9400-4ba4-8588-2b0594157e55', None, None, None, None, None)] {{(pid=117742) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:18:18.283970 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-fdf6f61b-be6e-4651-92ce-0404e45b4754 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:18.284988 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-fdf6f61b-be6e-4651-92ce-0404e45b4754 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:18.300257 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fdf6f61b-be6e-4651-92ce-0404e45b4754 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:18.300711 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fdf6f61b-be6e-4651-92ce-0404e45b4754 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:18.304878 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fdf6f61b-be6e-4651-92ce-0404e45b4754 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:18.305415 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fdf6f61b-be6e-4651-92ce-0404e45b4754 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:18.984005 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-fdf6f61b-be6e-4651-92ce-0404e45b4754 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:18.994085 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-fdf6f61b-be6e-4651-92ce-0404e45b4754 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:18.999495 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-fdf6f61b-be6e-4651-92ce-0404e45b4754 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:19.003445 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-fdf6f61b-be6e-4651-92ce-0404e45b4754 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.723452 May 27 15:18:19.004260 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 232/486] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:18:18 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:19.011945 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-7f33e610-145e-4682-b844-d357350eae97 req-11ed5383-efe3-4088-b8c5-f3faefbacd0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b91f595-1d49-4eed-8d8c-57bb287d34b5", "tag": "912582f8-c57d-4774-8d6c-0a14883de730"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:19.036852 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-7f33e610-145e-4682-b844-d357350eae97 req-11ed5383-efe3-4088-b8c5-f3faefbacd0b service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:19.037304 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-7f33e610-145e-4682-b844-d357350eae97 req-11ed5383-efe3-4088-b8c5-f3faefbacd0b service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:19.069696 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-7f33e610-145e-4682-b844-d357350eae97 req-11ed5383-efe3-4088-b8c5-f3faefbacd0b service nova] Creating event network-changed:912582f8-c57d-4774-8d6c-0a14883de730 for instance 5b91f595-1d49-4eed-8d8c-57bb287d34b5 on hv-cinder-84254 May 27 15:18:19.074645 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-94c93647-872a-47bf-8847-504390299c8a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Flavor limits 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:18:19.075278 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-94c93647-872a-47bf-8847-504390299c8a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Image limits 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:18:19.075894 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-94c93647-872a-47bf-8847-504390299c8a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Flavor pref 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:18:19.076445 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-94c93647-872a-47bf-8847-504390299c8a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Image pref 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:18:19.077139 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-94c93647-872a-47bf-8847-504390299c8a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:18:19.088800 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-94c93647-872a-47bf-8847-504390299c8a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:19.089000 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-7f33e610-145e-4682-b844-d357350eae97 req-11ed5383-efe3-4088-b8c5-f3faefbacd0b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082380 May 27 15:18:19.089619 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-94c93647-872a-47bf-8847-504390299c8a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:19.089734 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 233/487] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:19.092290 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-94c93647-872a-47bf-8847-504390299c8a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:19.092749 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-94c93647-872a-47bf-8847-504390299c8a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:19.138425 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-94c93647-872a-47bf-8847-504390299c8a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Getting quotas for project 58318fdd40dd469099dade09793f6b38. Resources: {'cores', 'ram', 'instances'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:18:19.144659 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-94c93647-872a-47bf-8847-504390299c8a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Getting quotas for user 0b257d6c8a034981be9b54789c313d3c and project 58318fdd40dd469099dade09793f6b38. Resources: {'cores', 'ram', 'instances'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:18:19.184379 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-94c93647-872a-47bf-8847-504390299c8a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Going to run 1 instances... {{(pid=117742) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:18:19.187312 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-94c93647-872a-47bf-8847-504390299c8a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: f119703c-9079-4ecb-a5c9-b767c10cacdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9407644-1f68-43e6-beb1-ce2085766180',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117742) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:18:19.259334 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-94c93647-872a-47bf-8847-504390299c8a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.139678 May 27 15:18:19.266650 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 255/488] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 15:18:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:18:19.272687 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-19a5cff7-bf7f-4cf2-8b6c-ba07e7d849bd tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:19.274463 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-19a5cff7-bf7f-4cf2-8b6c-ba07e7d849bd tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: f119703c-9079-4ecb-a5c9-b767c10cacdd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:19.415348 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b6d23fb4-7f67-43a9-bd10-f108982adb28 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Action: 'create', calling method: .version_select at 0x7f57e20be820>, body: {"keypair": {"name": "tempest-TestShelveInstance-1482917948", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRfKSPIgLO1LBzHwljYMjIGcLcSnodMp9yOvGqVYMY4cT+oNZG554mCwi+YLOTdU0yfpJWB0greqEMDSC93Y7zx+D8bX/ngacOpBB/Y0xPW9mMDRQGXhDuWZl5vqdcqmg=="}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:19.417281 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-19a5cff7-bf7f-4cf2-8b6c-ba07e7d849bd tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:19.424724 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-19a5cff7-bf7f-4cf2-8b6c-ba07e7d849bd tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd" status: 200 len: 1219 microversion: 2.1 time: 0.156088 May 27 15:18:19.426680 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 256/489] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:19 2022] GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:19.444230 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-b6d23fb4-7f67-43a9-bd10-f108982adb28 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Getting quotas for project 520d6685a60d4d9b8b7415d11b01a8f0. Resources: {'key_pairs'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:18:19.450324 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-b6d23fb4-7f67-43a9-bd10-f108982adb28 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Getting quotas for user f52a9eabb6f84931b8f0af715af9eb36 and project 520d6685a60d4d9b8b7415d11b01a8f0. Resources: {'key_pairs'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:18:19.490492 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b6d23fb4-7f67-43a9-bd10-f108982adb28 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.386558 May 27 15:18:19.491446 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 234/490] 10.222.0.50 () {60 vars in 1158 bytes} [Fri May 27 15:18:19 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:19.789826 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-948e898f-5a08-4f5c-9d1f-5704843ce5f3 req-c5bdab26-5ae4-4a25-91f0-d872b017d6cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88bbd4b-d173-4df5-9e19-4fedb81b4aed", "name": "network-vif-plugged", "status": "completed", "tag": "b65a7130-71a7-4267-9201-c07ec8e83b00"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:19.816374 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-948e898f-5a08-4f5c-9d1f-5704843ce5f3 req-c5bdab26-5ae4-4a25-91f0-d872b017d6cf service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:19.816880 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-948e898f-5a08-4f5c-9d1f-5704843ce5f3 req-c5bdab26-5ae4-4a25-91f0-d872b017d6cf service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:19.832920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-948e898f-5a08-4f5c-9d1f-5704843ce5f3 req-c5bdab26-5ae4-4a25-91f0-d872b017d6cf service nova] Creating event network-vif-plugged:b65a7130-71a7-4267-9201-c07ec8e83b00 for instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed on hv-cinder-84254 May 27 15:18:19.840100 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-948e898f-5a08-4f5c-9d1f-5704843ce5f3 req-c5bdab26-5ae4-4a25-91f0-d872b017d6cf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059056 May 27 15:18:19.841075 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 257/491] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:20.033640 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-48436adc-3551-425f-b12c-639f7b8b05a4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:20.035211 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-48436adc-3551-425f-b12c-639f7b8b05a4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:20.047684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-48436adc-3551-425f-b12c-639f7b8b05a4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:20.048778 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-48436adc-3551-425f-b12c-639f7b8b05a4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:20.050134 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-48436adc-3551-425f-b12c-639f7b8b05a4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:20.050680 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-48436adc-3551-425f-b12c-639f7b8b05a4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:20.307570 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-48436adc-3551-425f-b12c-639f7b8b05a4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:20.322940 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-48436adc-3551-425f-b12c-639f7b8b05a4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:20.337261 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-48436adc-3551-425f-b12c-639f7b8b05a4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:20.339326 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-48436adc-3551-425f-b12c-639f7b8b05a4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.320681 May 27 15:18:20.349947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 235/492] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:18:20 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:20.449544 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-47f0fe20-8a79-41c9-a8da-ff2e5618ef9e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:20.451806 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-47f0fe20-8a79-41c9-a8da-ff2e5618ef9e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: f119703c-9079-4ecb-a5c9-b767c10cacdd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:20.470124 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-47f0fe20-8a79-41c9-a8da-ff2e5618ef9e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:20.471049 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-47f0fe20-8a79-41c9-a8da-ff2e5618ef9e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:20.472168 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-47f0fe20-8a79-41c9-a8da-ff2e5618ef9e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:20.472862 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-47f0fe20-8a79-41c9-a8da-ff2e5618ef9e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:20.618970 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-47f0fe20-8a79-41c9-a8da-ff2e5618ef9e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:20.629753 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-47f0fe20-8a79-41c9-a8da-ff2e5618ef9e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd" status: 200 len: 1271 microversion: 2.1 time: 0.188917 May 27 15:18:20.630646 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 258/493] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:20 2022] GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd => generated 1271 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:20.700790 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-43a68b1b-3ed1-4dd2-9e76-e0bca8186641 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:20.702436 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-43a68b1b-3ed1-4dd2-9e76-e0bca8186641 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:20.708711 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-43a68b1b-3ed1-4dd2-9e76-e0bca8186641 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:20.709121 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-43a68b1b-3ed1-4dd2-9e76-e0bca8186641 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:20.709904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-43a68b1b-3ed1-4dd2-9e76-e0bca8186641 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:20.710521 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-43a68b1b-3ed1-4dd2-9e76-e0bca8186641 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:20.838715 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-43a68b1b-3ed1-4dd2-9e76-e0bca8186641 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "POST /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c/action" status: 202 len: 0 microversion: 2.1 time: 0.142190 May 27 15:18:20.839535 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 236/494] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 15:18:20 2022] POST /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:18:20.850098 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f4bf0716-3d19-40b6-80c7-80f040697776 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:20.851760 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f4bf0716-3d19-40b6-80c7-80f040697776 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:20.859590 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f4bf0716-3d19-40b6-80c7-80f040697776 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:20.860045 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f4bf0716-3d19-40b6-80c7-80f040697776 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:20.860762 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f4bf0716-3d19-40b6-80c7-80f040697776 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:20.861368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f4bf0716-3d19-40b6-80c7-80f040697776 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:21.103643 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f4bf0716-3d19-40b6-80c7-80f040697776 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:21.115893 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f4bf0716-3d19-40b6-80c7-80f040697776 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1752 microversion: 2.1 time: 0.269976 May 27 15:18:21.133555 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 259/495] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:20 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1752 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:21.360992 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-712cd83b-c77b-444d-b567-f01ad326b8d5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:21.362587 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-712cd83b-c77b-444d-b567-f01ad326b8d5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:21.374104 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-1887dde5-353b-404f-bcdb-a9bad5aed2f3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:21.374801 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-1887dde5-353b-404f-bcdb-a9bad5aed2f3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:21.383215 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1887dde5-353b-404f-bcdb-a9bad5aed2f3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:21.383661 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1887dde5-353b-404f-bcdb-a9bad5aed2f3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:21.384986 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1887dde5-353b-404f-bcdb-a9bad5aed2f3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:21.385423 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1887dde5-353b-404f-bcdb-a9bad5aed2f3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:21.389370 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-712cd83b-c77b-444d-b567-f01ad326b8d5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:21.389830 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-712cd83b-c77b-444d-b567-f01ad326b8d5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:21.390664 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-712cd83b-c77b-444d-b567-f01ad326b8d5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:21.391135 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-712cd83b-c77b-444d-b567-f01ad326b8d5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:21.609251 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.objects.instance [None req-1887dde5-353b-404f-bcdb-a9bad5aed2f3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lazy-loading 'services' on Instance uuid f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 {{(pid=117742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:18:21.648860 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-712cd83b-c77b-444d-b567-f01ad326b8d5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:21.659607 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-712cd83b-c77b-444d-b567-f01ad326b8d5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:21.661543 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-712cd83b-c77b-444d-b567-f01ad326b8d5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:21.662951 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-712cd83b-c77b-444d-b567-f01ad326b8d5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.306674 May 27 15:18:21.673971 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 237/496] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:18:21 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:21.673971 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-1bad443c-9dc4-4473-a677-6b955af28444 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:21.673971 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-1bad443c-9dc4-4473-a677-6b955af28444 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: f119703c-9079-4ecb-a5c9-b767c10cacdd] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:21.677029 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1bad443c-9dc4-4473-a677-6b955af28444 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:21.677661 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1bad443c-9dc4-4473-a677-6b955af28444 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:21.678997 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1bad443c-9dc4-4473-a677-6b955af28444 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:21.679621 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1bad443c-9dc4-4473-a677-6b955af28444 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:21.766714 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-1bad443c-9dc4-4473-a677-6b955af28444 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:21.776407 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-1887dde5-353b-404f-bcdb-a9bad5aed2f3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27/os-volume_attachments/267077e5-d95e-433d-807c-18d37debb8be" status: 202 len: 0 microversion: 2.1 time: 0.409042 May 27 15:18:21.777922 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 260/497] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 15:18:21 2022] DELETE /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27/os-volume_attachments/267077e5-d95e-433d-807c-18d37debb8be => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:18:21.778587 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-1bad443c-9dc4-4473-a677-6b955af28444 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd" status: 200 len: 1289 microversion: 2.1 time: 0.113669 May 27 15:18:21.779456 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 238/498] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:21 2022] GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd => generated 1289 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:22.134211 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e139c199-aece-4e15-8433-da48ca57cb80 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:22.135814 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e139c199-aece-4e15-8433-da48ca57cb80 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:22.164814 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e139c199-aece-4e15-8433-da48ca57cb80 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:22.168081 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e139c199-aece-4e15-8433-da48ca57cb80 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:22.171978 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e139c199-aece-4e15-8433-da48ca57cb80 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:22.172474 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e139c199-aece-4e15-8433-da48ca57cb80 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:22.444435 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-e139c199-aece-4e15-8433-da48ca57cb80 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:22.463747 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-e139c199-aece-4e15-8433-da48ca57cb80 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1752 microversion: 2.1 time: 0.333038 May 27 15:18:22.464983 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 261/499] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:22 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1752 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:22.682315 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b83e8b95-fe56-46d0-8167-592dfb90c2e3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:22.683707 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b83e8b95-fe56-46d0-8167-592dfb90c2e3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:22.694923 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b83e8b95-fe56-46d0-8167-592dfb90c2e3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:22.695789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b83e8b95-fe56-46d0-8167-592dfb90c2e3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:22.696883 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b83e8b95-fe56-46d0-8167-592dfb90c2e3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:22.697901 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b83e8b95-fe56-46d0-8167-592dfb90c2e3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:22.796624 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-01557479-ae98-4096-959a-b582430efdd0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:22.797326 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-01557479-ae98-4096-959a-b582430efdd0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: f119703c-9079-4ecb-a5c9-b767c10cacdd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:22.808560 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-01557479-ae98-4096-959a-b582430efdd0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:22.809751 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-01557479-ae98-4096-959a-b582430efdd0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:22.810757 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-01557479-ae98-4096-959a-b582430efdd0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:22.811394 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-01557479-ae98-4096-959a-b582430efdd0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:22.965059 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-01557479-ae98-4096-959a-b582430efdd0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:22.981900 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b83e8b95-fe56-46d0-8167-592dfb90c2e3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:22.986866 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-01557479-ae98-4096-959a-b582430efdd0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd" status: 200 len: 1277 microversion: 2.1 time: 0.189096 May 27 15:18:22.987552 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 262/500] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:22 2022] GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:23.012655 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b83e8b95-fe56-46d0-8167-592dfb90c2e3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:23.014557 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b83e8b95-fe56-46d0-8167-592dfb90c2e3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:23.017116 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b83e8b95-fe56-46d0-8167-592dfb90c2e3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1806 microversion: 2.20 time: 0.339150 May 27 15:18:23.018189 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 239/501] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:18:22 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1806 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:23.482247 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-608cde25-77f2-4df4-9b21-4c7f37677672 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:23.483748 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-608cde25-77f2-4df4-9b21-4c7f37677672 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:23.493375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-608cde25-77f2-4df4-9b21-4c7f37677672 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:23.493896 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-608cde25-77f2-4df4-9b21-4c7f37677672 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:23.494698 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-608cde25-77f2-4df4-9b21-4c7f37677672 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:23.495188 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-608cde25-77f2-4df4-9b21-4c7f37677672 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:23.679217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-608cde25-77f2-4df4-9b21-4c7f37677672 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:23.689945 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-608cde25-77f2-4df4-9b21-4c7f37677672 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1752 microversion: 2.1 time: 0.212169 May 27 15:18:23.690541 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 263/502] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:23 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1752 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:24.006492 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d25550c3-ed11-4f80-bed2-1769c7eca48c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:24.007231 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-d25550c3-ed11-4f80-bed2-1769c7eca48c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: f119703c-9079-4ecb-a5c9-b767c10cacdd] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:24.015440 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d25550c3-ed11-4f80-bed2-1769c7eca48c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:24.015895 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d25550c3-ed11-4f80-bed2-1769c7eca48c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:24.016675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d25550c3-ed11-4f80-bed2-1769c7eca48c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:24.017113 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d25550c3-ed11-4f80-bed2-1769c7eca48c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:24.043420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e73311bf-06ed-4d9e-a15d-2f0d27dffadb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:24.044623 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e73311bf-06ed-4d9e-a15d-2f0d27dffadb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:24.060303 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e73311bf-06ed-4d9e-a15d-2f0d27dffadb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:24.064028 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e73311bf-06ed-4d9e-a15d-2f0d27dffadb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:24.070960 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e73311bf-06ed-4d9e-a15d-2f0d27dffadb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:24.072938 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e73311bf-06ed-4d9e-a15d-2f0d27dffadb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:24.302019 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d25550c3-ed11-4f80-bed2-1769c7eca48c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:24.310232 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-d25550c3-ed11-4f80-bed2-1769c7eca48c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd" status: 200 len: 1319 microversion: 2.1 time: 0.309567 May 27 15:18:24.320170 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 240/503] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:23 2022] GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:24.345323 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-e73311bf-06ed-4d9e-a15d-2f0d27dffadb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:24.355975 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-e73311bf-06ed-4d9e-a15d-2f0d27dffadb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:24.357746 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-e73311bf-06ed-4d9e-a15d-2f0d27dffadb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:24.360091 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-e73311bf-06ed-4d9e-a15d-2f0d27dffadb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1793 microversion: 2.20 time: 0.328069 May 27 15:18:24.361617 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 264/504] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:18:24 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1793 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:18:24.709418 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-486a943a-8f62-484f-9373-59e6bfc6f061 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:24.710065 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-486a943a-8f62-484f-9373-59e6bfc6f061 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:24.717222 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-486a943a-8f62-484f-9373-59e6bfc6f061 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:24.717674 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-486a943a-8f62-484f-9373-59e6bfc6f061 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:24.718446 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-486a943a-8f62-484f-9373-59e6bfc6f061 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:24.719167 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-486a943a-8f62-484f-9373-59e6bfc6f061 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:24.763867 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-3e19e8c0-f43a-4c4b-96cf-f47523a905c1 req-309f4d50-85e7-4513-a402-e5dc892a021f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f119703c-9079-4ecb-a5c9-b767c10cacdd", "tag": "a844e1cd-316b-4667-aef7-a02995f01389"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:24.781556 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-3e19e8c0-f43a-4c4b-96cf-f47523a905c1 req-309f4d50-85e7-4513-a402-e5dc892a021f service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:24.782054 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-3e19e8c0-f43a-4c4b-96cf-f47523a905c1 req-309f4d50-85e7-4513-a402-e5dc892a021f service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:24.796874 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-3e19e8c0-f43a-4c4b-96cf-f47523a905c1 req-309f4d50-85e7-4513-a402-e5dc892a021f service nova] Creating event network-changed:a844e1cd-316b-4667-aef7-a02995f01389 for instance f119703c-9079-4ecb-a5c9-b767c10cacdd on hv-cinder-84254 May 27 15:18:24.802288 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-3e19e8c0-f43a-4c4b-96cf-f47523a905c1 req-309f4d50-85e7-4513-a402-e5dc892a021f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042505 May 27 15:18:24.802920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 265/505] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:18:24.873322 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-486a943a-8f62-484f-9373-59e6bfc6f061 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:24.883155 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-486a943a-8f62-484f-9373-59e6bfc6f061 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1757 microversion: 2.1 time: 0.178103 May 27 15:18:24.884189 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 241/506] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:24 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:25.163587 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-45af497b-6ddd-4962-bd35-7645b789cfb3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:25.171251 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-45af497b-6ddd-4962-bd35-7645b789cfb3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:25.171780 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-45af497b-6ddd-4962-bd35-7645b789cfb3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:25.232376 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-45af497b-6ddd-4962-bd35-7645b789cfb3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Going to try to stop instance {{(pid=117742) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 15:18:25.279603 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-45af497b-6ddd-4962-bd35-7645b789cfb3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "POST /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27/action" status: 202 len: 0 microversion: 2.1 time: 0.119842 May 27 15:18:25.281344 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 266/507] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 15:18:25 2022] POST /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:18:25.289635 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-3014d31e-879b-447d-8f3a-3fcef4213e85 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:25.290775 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-3014d31e-879b-447d-8f3a-3fcef4213e85 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:25.298167 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3014d31e-879b-447d-8f3a-3fcef4213e85 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:25.298769 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3014d31e-879b-447d-8f3a-3fcef4213e85 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:25.299450 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3014d31e-879b-447d-8f3a-3fcef4213e85 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:25.299893 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3014d31e-879b-447d-8f3a-3fcef4213e85 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:25.329162 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-19317c6f-9206-4bf5-94cb-fc6af0e4e3fe tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:25.330277 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-19317c6f-9206-4bf5-94cb-fc6af0e4e3fe tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: f119703c-9079-4ecb-a5c9-b767c10cacdd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:25.339233 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-19317c6f-9206-4bf5-94cb-fc6af0e4e3fe tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:25.339673 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-19317c6f-9206-4bf5-94cb-fc6af0e4e3fe tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:25.340687 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-19317c6f-9206-4bf5-94cb-fc6af0e4e3fe tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:25.341119 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-19317c6f-9206-4bf5-94cb-fc6af0e4e3fe tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:25.496497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-3014d31e-879b-447d-8f3a-3fcef4213e85 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:25.504243 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-3014d31e-879b-447d-8f3a-3fcef4213e85 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1678 microversion: 2.1 time: 0.218650 May 27 15:18:25.505493 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 242/508] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:25 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1678 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:25.526568 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-19317c6f-9206-4bf5-94cb-fc6af0e4e3fe tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:25.533914 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-19317c6f-9206-4bf5-94cb-fc6af0e4e3fe tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd" status: 200 len: 1319 microversion: 2.1 time: 0.210021 May 27 15:18:25.534529 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 267/509] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:25 2022] GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:25.901957 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-827c0e32-bd15-4f02-8e37-d849907ab6f5 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:25.902566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-827c0e32-bd15-4f02-8e37-d849907ab6f5 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:25.910047 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-827c0e32-bd15-4f02-8e37-d849907ab6f5 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:25.910490 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-827c0e32-bd15-4f02-8e37-d849907ab6f5 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:25.911278 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-827c0e32-bd15-4f02-8e37-d849907ab6f5 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:25.911708 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-827c0e32-bd15-4f02-8e37-d849907ab6f5 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:26.062877 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-827c0e32-bd15-4f02-8e37-d849907ab6f5 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:26.071289 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-827c0e32-bd15-4f02-8e37-d849907ab6f5 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1757 microversion: 2.1 time: 0.174054 May 27 15:18:26.072937 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 243/510] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:25 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:26.522006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ec9e9de1-d243-47ce-8c40-a4be6e1b6388 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:26.522609 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ec9e9de1-d243-47ce-8c40-a4be6e1b6388 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:26.529201 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ec9e9de1-d243-47ce-8c40-a4be6e1b6388 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:26.529889 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ec9e9de1-d243-47ce-8c40-a4be6e1b6388 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:26.530398 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ec9e9de1-d243-47ce-8c40-a4be6e1b6388 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:26.530831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ec9e9de1-d243-47ce-8c40-a4be6e1b6388 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:26.551472 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-e0441b34-8dfe-4eef-a5c4-daa988ce0215 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:26.552088 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-e0441b34-8dfe-4eef-a5c4-daa988ce0215 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: f119703c-9079-4ecb-a5c9-b767c10cacdd] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:26.559338 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e0441b34-8dfe-4eef-a5c4-daa988ce0215 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:26.560002 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e0441b34-8dfe-4eef-a5c4-daa988ce0215 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:26.560941 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e0441b34-8dfe-4eef-a5c4-daa988ce0215 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:26.561352 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e0441b34-8dfe-4eef-a5c4-daa988ce0215 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:26.715151 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-ec9e9de1-d243-47ce-8c40-a4be6e1b6388 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:26.722880 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ec9e9de1-d243-47ce-8c40-a4be6e1b6388 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1678 microversion: 2.1 time: 0.204701 May 27 15:18:26.723458 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 268/511] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:26 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1678 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:26.741687 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-e0441b34-8dfe-4eef-a5c4-daa988ce0215 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:26.749970 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-e0441b34-8dfe-4eef-a5c4-daa988ce0215 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd" status: 200 len: 1319 microversion: 2.1 time: 0.202435 May 27 15:18:26.750537 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 244/512] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:26 2022] GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:27.089738 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-0ec41555-bf59-407b-bd27-55ea228834ee tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:27.090336 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-0ec41555-bf59-407b-bd27-55ea228834ee tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:27.096618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0ec41555-bf59-407b-bd27-55ea228834ee tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:27.097060 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0ec41555-bf59-407b-bd27-55ea228834ee tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:27.097808 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0ec41555-bf59-407b-bd27-55ea228834ee tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:27.098233 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0ec41555-bf59-407b-bd27-55ea228834ee tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:27.241933 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-0ec41555-bf59-407b-bd27-55ea228834ee tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:27.250714 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-0ec41555-bf59-407b-bd27-55ea228834ee tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1757 microversion: 2.1 time: 0.165450 May 27 15:18:27.251494 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 269/513] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:27 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:27.740847 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-2b3a7d7b-bd0a-4bee-acf5-3c345b5fa88e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:27.741461 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-2b3a7d7b-bd0a-4bee-acf5-3c345b5fa88e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:27.748912 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2b3a7d7b-bd0a-4bee-acf5-3c345b5fa88e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:27.749358 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2b3a7d7b-bd0a-4bee-acf5-3c345b5fa88e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:27.750124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2b3a7d7b-bd0a-4bee-acf5-3c345b5fa88e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:27.750568 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2b3a7d7b-bd0a-4bee-acf5-3c345b5fa88e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:27.753337 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:27.767004 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-702c0957-3ac4-496f-abb1-e0978d05d17a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:27.767950 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-702c0957-3ac4-496f-abb1-e0978d05d17a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: f119703c-9079-4ecb-a5c9-b767c10cacdd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:27.774265 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-702c0957-3ac4-496f-abb1-e0978d05d17a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:27.774968 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-702c0957-3ac4-496f-abb1-e0978d05d17a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:27.775897 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-702c0957-3ac4-496f-abb1-e0978d05d17a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:27.776325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-702c0957-3ac4-496f-abb1-e0978d05d17a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:27.954185 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-2b3a7d7b-bd0a-4bee-acf5-3c345b5fa88e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:27.961385 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-702c0957-3ac4-496f-abb1-e0978d05d17a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:27.962150 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-2b3a7d7b-bd0a-4bee-acf5-3c345b5fa88e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1678 microversion: 2.1 time: 0.225093 May 27 15:18:27.962792 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 245/514] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:27 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1678 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:27.972599 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-702c0957-3ac4-496f-abb1-e0978d05d17a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd" status: 200 len: 1319 microversion: 2.1 time: 0.209373 May 27 15:18:27.973343 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 270/515] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:27 2022] GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:28.268373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-44f92c3a-509d-4188-991f-6c4c259ff44c tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:28.268981 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-44f92c3a-509d-4188-991f-6c4c259ff44c tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:28.279206 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-44f92c3a-509d-4188-991f-6c4c259ff44c tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:28.279206 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-44f92c3a-509d-4188-991f-6c4c259ff44c tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:28.279206 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-44f92c3a-509d-4188-991f-6c4c259ff44c tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:28.279206 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-44f92c3a-509d-4188-991f-6c4c259ff44c tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:28.436280 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-44f92c3a-509d-4188-991f-6c4c259ff44c tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:28.445527 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-44f92c3a-509d-4188-991f-6c4c259ff44c tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1757 microversion: 2.1 time: 0.180953 May 27 15:18:28.446107 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 246/516] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:28 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:28.981645 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-adc8c68b-b835-4c60-912c-29e3b8321f05 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:28.982488 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-adc8c68b-b835-4c60-912c-29e3b8321f05 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:28.990301 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-adc8c68b-b835-4c60-912c-29e3b8321f05 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:28.991196 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-adc8c68b-b835-4c60-912c-29e3b8321f05 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:28.991842 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-0fb4ad21-df56-4ef3-b89d-9fff0c57ca4a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:28.992381 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-adc8c68b-b835-4c60-912c-29e3b8321f05 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:28.993049 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-adc8c68b-b835-4c60-912c-29e3b8321f05 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:28.993151 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-0fb4ad21-df56-4ef3-b89d-9fff0c57ca4a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: f119703c-9079-4ecb-a5c9-b767c10cacdd] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:29.000927 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0fb4ad21-df56-4ef3-b89d-9fff0c57ca4a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:29.001634 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0fb4ad21-df56-4ef3-b89d-9fff0c57ca4a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:29.002375 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0fb4ad21-df56-4ef3-b89d-9fff0c57ca4a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:29.003075 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0fb4ad21-df56-4ef3-b89d-9fff0c57ca4a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:29.014613 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:29.125760 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=2 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:29.201477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-adc8c68b-b835-4c60-912c-29e3b8321f05 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:29.208199 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-0fb4ad21-df56-4ef3-b89d-9fff0c57ca4a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:29.209173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-adc8c68b-b835-4c60-912c-29e3b8321f05 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1678 microversion: 2.1 time: 0.233256 May 27 15:18:29.209751 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 271/517] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:28 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1678 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:29.216567 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-0fb4ad21-df56-4ef3-b89d-9fff0c57ca4a tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd" status: 200 len: 1319 microversion: 2.1 time: 0.229703 May 27 15:18:29.218329 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 247/518] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:28 2022] GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:29.463511 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-c5287ad5-087b-4882-8653-507d1e296943 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:29.464112 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-c5287ad5-087b-4882-8653-507d1e296943 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:29.465973 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=8 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:29.471805 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c5287ad5-087b-4882-8653-507d1e296943 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:29.472251 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c5287ad5-087b-4882-8653-507d1e296943 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:29.473042 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c5287ad5-087b-4882-8653-507d1e296943 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:29.473480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c5287ad5-087b-4882-8653-507d1e296943 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:29.617076 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-c5287ad5-087b-4882-8653-507d1e296943 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:29.625248 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-c5287ad5-087b-4882-8653-507d1e296943 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1757 microversion: 2.1 time: 0.166322 May 27 15:18:29.625858 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 272/519] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:29 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:30.228892 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-bf9399bc-af54-499d-aed2-83b7d08d783b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:30.229505 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-bf9399bc-af54-499d-aed2-83b7d08d783b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:30.235092 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-86f54876-fad7-4dc0-9f48-8866cb5d15b1 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:30.235893 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=4 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:30.236017 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-86f54876-fad7-4dc0-9f48-8866cb5d15b1 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: f119703c-9079-4ecb-a5c9-b767c10cacdd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:30.238294 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bf9399bc-af54-499d-aed2-83b7d08d783b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:30.238752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bf9399bc-af54-499d-aed2-83b7d08d783b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:30.239569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bf9399bc-af54-499d-aed2-83b7d08d783b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:30.240012 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bf9399bc-af54-499d-aed2-83b7d08d783b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:30.242955 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-86f54876-fad7-4dc0-9f48-8866cb5d15b1 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:30.243499 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-86f54876-fad7-4dc0-9f48-8866cb5d15b1 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:30.244413 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-86f54876-fad7-4dc0-9f48-8866cb5d15b1 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:30.245098 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-86f54876-fad7-4dc0-9f48-8866cb5d15b1 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:30.459615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-bf9399bc-af54-499d-aed2-83b7d08d783b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:30.461554 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-86f54876-fad7-4dc0-9f48-8866cb5d15b1 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:30.470323 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-bf9399bc-af54-499d-aed2-83b7d08d783b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1678 microversion: 2.1 time: 0.246307 May 27 15:18:30.482119 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-86f54876-fad7-4dc0-9f48-8866cb5d15b1 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd" status: 200 len: 1319 microversion: 2.1 time: 0.240562 May 27 15:18:30.482119 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 273/520] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:30 2022] GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:30.482119 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-7eb52b21-25fa-43f3-99ca-0eb0031379a8 req-72c7f86e-ac0d-4bd4-9274-c0f2148c6b84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f119703c-9079-4ecb-a5c9-b767c10cacdd", "name": "network-vif-plugged", "status": "completed", "tag": "a844e1cd-316b-4667-aef7-a02995f01389"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:30.483264 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 248/521] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:30 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1678 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:30.486791 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-7eb52b21-25fa-43f3-99ca-0eb0031379a8 req-72c7f86e-ac0d-4bd4-9274-c0f2148c6b84 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:30.487269 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-7eb52b21-25fa-43f3-99ca-0eb0031379a8 req-72c7f86e-ac0d-4bd4-9274-c0f2148c6b84 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:30.500672 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-7eb52b21-25fa-43f3-99ca-0eb0031379a8 req-72c7f86e-ac0d-4bd4-9274-c0f2148c6b84 service nova] Creating event network-vif-plugged:a844e1cd-316b-4667-aef7-a02995f01389 for instance f119703c-9079-4ecb-a5c9-b767c10cacdd on hv-cinder-84254 May 27 15:18:30.507053 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-7eb52b21-25fa-43f3-99ca-0eb0031379a8 req-72c7f86e-ac0d-4bd4-9274-c0f2148c6b84 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032306 May 27 15:18:30.508320 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 274/522] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:30.644286 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a8b13294-c3a9-450b-b327-1a8b9bccefb0 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:30.644935 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a8b13294-c3a9-450b-b327-1a8b9bccefb0 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:30.653453 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a8b13294-c3a9-450b-b327-1a8b9bccefb0 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:30.654360 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a8b13294-c3a9-450b-b327-1a8b9bccefb0 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:30.655690 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a8b13294-c3a9-450b-b327-1a8b9bccefb0 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:30.656208 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a8b13294-c3a9-450b-b327-1a8b9bccefb0 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:30.802373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a8b13294-c3a9-450b-b327-1a8b9bccefb0 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:30.811038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a8b13294-c3a9-450b-b327-1a8b9bccefb0 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1757 microversion: 2.1 time: 0.170679 May 27 15:18:30.811618 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 249/523] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:30 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:31.489996 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b9862518-6b6d-4764-bd7a-ca5e9a2878a3 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:31.490770 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b9862518-6b6d-4764-bd7a-ca5e9a2878a3 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: f119703c-9079-4ecb-a5c9-b767c10cacdd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:31.491027 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-73cb357c-be41-465e-bf1c-7dc8a5ee64e8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:31.491493 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-73cb357c-be41-465e-bf1c-7dc8a5ee64e8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:31.498932 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b9862518-6b6d-4764-bd7a-ca5e9a2878a3 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:31.499133 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-73cb357c-be41-465e-bf1c-7dc8a5ee64e8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:31.499235 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-73cb357c-be41-465e-bf1c-7dc8a5ee64e8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:31.499387 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b9862518-6b6d-4764-bd7a-ca5e9a2878a3 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:31.500004 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-73cb357c-be41-465e-bf1c-7dc8a5ee64e8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:31.500284 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b9862518-6b6d-4764-bd7a-ca5e9a2878a3 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:31.500447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-73cb357c-be41-465e-bf1c-7dc8a5ee64e8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:31.500852 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b9862518-6b6d-4764-bd7a-ca5e9a2878a3 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:31.696082 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-73cb357c-be41-465e-bf1c-7dc8a5ee64e8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:31.704488 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b9862518-6b6d-4764-bd7a-ca5e9a2878a3 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:31.704637 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-73cb357c-be41-465e-bf1c-7dc8a5ee64e8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1678 microversion: 2.1 time: 0.217588 May 27 15:18:31.705068 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 250/524] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:31 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1678 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:31.712133 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b9862518-6b6d-4764-bd7a-ca5e9a2878a3 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd" status: 200 len: 1319 microversion: 2.1 time: 0.226404 May 27 15:18:31.712779 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 275/525] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:31 2022] GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:31.827872 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a004f5c9-a76c-4207-9edf-e7e5f79fdd54 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:31.828482 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a004f5c9-a76c-4207-9edf-e7e5f79fdd54 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:31.834451 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a004f5c9-a76c-4207-9edf-e7e5f79fdd54 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:31.834924 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a004f5c9-a76c-4207-9edf-e7e5f79fdd54 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:31.835715 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a004f5c9-a76c-4207-9edf-e7e5f79fdd54 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:31.836147 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a004f5c9-a76c-4207-9edf-e7e5f79fdd54 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:31.982421 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a004f5c9-a76c-4207-9edf-e7e5f79fdd54 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:31.990440 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a004f5c9-a76c-4207-9edf-e7e5f79fdd54 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1757 microversion: 2.1 time: 0.167256 May 27 15:18:31.991044 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 251/526] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:31 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:32.722882 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e8696b99-1bab-4c02-94cb-6b4607603fd4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:32.723456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e8696b99-1bab-4c02-94cb-6b4607603fd4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:32.730082 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e8696b99-1bab-4c02-94cb-6b4607603fd4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:32.730276 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-09db505b-c418-4b34-9458-2e71d9e632e7 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:32.730676 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e8696b99-1bab-4c02-94cb-6b4607603fd4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:32.730778 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-09db505b-c418-4b34-9458-2e71d9e632e7 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: f119703c-9079-4ecb-a5c9-b767c10cacdd] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:32.731309 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e8696b99-1bab-4c02-94cb-6b4607603fd4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:32.731828 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e8696b99-1bab-4c02-94cb-6b4607603fd4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:32.736887 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-09db505b-c418-4b34-9458-2e71d9e632e7 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:32.737340 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-09db505b-c418-4b34-9458-2e71d9e632e7 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:32.738112 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-09db505b-c418-4b34-9458-2e71d9e632e7 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:32.741406 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-09db505b-c418-4b34-9458-2e71d9e632e7 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:32.938523 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-e8696b99-1bab-4c02-94cb-6b4607603fd4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:32.942314 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-09db505b-c418-4b34-9458-2e71d9e632e7 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:32.946443 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-e8696b99-1bab-4c02-94cb-6b4607603fd4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1678 microversion: 2.1 time: 0.228242 May 27 15:18:32.947127 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 276/527] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:32 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1678 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:32.950558 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-09db505b-c418-4b34-9458-2e71d9e632e7 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd" status: 200 len: 1507 microversion: 2.1 time: 0.225223 May 27 15:18:32.951157 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 252/528] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:32 2022] GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd => generated 1507 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:33.009735 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-72114d11-8c36-494a-8fe7-7788154fb995 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:33.011082 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-72114d11-8c36-494a-8fe7-7788154fb995 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:33.017747 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-72114d11-8c36-494a-8fe7-7788154fb995 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:33.018350 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-72114d11-8c36-494a-8fe7-7788154fb995 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:33.019419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-72114d11-8c36-494a-8fe7-7788154fb995 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:33.019948 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-72114d11-8c36-494a-8fe7-7788154fb995 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:33.185625 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-72114d11-8c36-494a-8fe7-7788154fb995 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:33.193549 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-72114d11-8c36-494a-8fe7-7788154fb995 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1757 microversion: 2.1 time: 0.187813 May 27 15:18:33.194116 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 277/529] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:33 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:33.966067 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9bfca1e1-a835-4a8f-b648-365a7ea84ae1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:33.966925 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9bfca1e1-a835-4a8f-b648-365a7ea84ae1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:33.973793 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9bfca1e1-a835-4a8f-b648-365a7ea84ae1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:33.974253 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9bfca1e1-a835-4a8f-b648-365a7ea84ae1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:33.975141 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9bfca1e1-a835-4a8f-b648-365a7ea84ae1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:33.975585 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9bfca1e1-a835-4a8f-b648-365a7ea84ae1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:34.111724 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9bfca1e1-a835-4a8f-b648-365a7ea84ae1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:34.119381 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9bfca1e1-a835-4a8f-b648-365a7ea84ae1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1678 microversion: 2.1 time: 0.158575 May 27 15:18:34.120544 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 253/530] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:33 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:34.212184 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-052e701f-3170-4f63-b2dd-0f3969c90f23 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:34.212796 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-052e701f-3170-4f63-b2dd-0f3969c90f23 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:34.219815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-052e701f-3170-4f63-b2dd-0f3969c90f23 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:34.220289 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-052e701f-3170-4f63-b2dd-0f3969c90f23 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:34.221056 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-052e701f-3170-4f63-b2dd-0f3969c90f23 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:34.221494 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-052e701f-3170-4f63-b2dd-0f3969c90f23 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:34.372580 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-052e701f-3170-4f63-b2dd-0f3969c90f23 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:34.380783 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-052e701f-3170-4f63-b2dd-0f3969c90f23 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1757 microversion: 2.1 time: 0.172441 May 27 15:18:34.381354 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 278/531] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:34 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:35.136606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-8c49400e-f272-4088-b31f-958fabab58b4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:35.137243 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-8c49400e-f272-4088-b31f-958fabab58b4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:35.143888 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8c49400e-f272-4088-b31f-958fabab58b4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:35.144329 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8c49400e-f272-4088-b31f-958fabab58b4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:35.145079 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8c49400e-f272-4088-b31f-958fabab58b4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:35.145512 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8c49400e-f272-4088-b31f-958fabab58b4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:35.275776 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-8c49400e-f272-4088-b31f-958fabab58b4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:35.283464 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-8c49400e-f272-4088-b31f-958fabab58b4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1678 microversion: 2.1 time: 0.151215 May 27 15:18:35.284062 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 254/532] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:35 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:35.398596 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-af9018d8-112f-43f6-91d6-07b7796ad046 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:35.399236 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-af9018d8-112f-43f6-91d6-07b7796ad046 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:35.406532 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-af9018d8-112f-43f6-91d6-07b7796ad046 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:35.407020 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-af9018d8-112f-43f6-91d6-07b7796ad046 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:35.407793 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-af9018d8-112f-43f6-91d6-07b7796ad046 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:35.408253 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-af9018d8-112f-43f6-91d6-07b7796ad046 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:35.556343 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-af9018d8-112f-43f6-91d6-07b7796ad046 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:35.565884 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-af9018d8-112f-43f6-91d6-07b7796ad046 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1757 microversion: 2.1 time: 0.171123 May 27 15:18:35.566465 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 279/533] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:35 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:36.301192 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-e96a93dc-2a6b-46e6-afa1-edeae2d40f22 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:36.301801 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-e96a93dc-2a6b-46e6-afa1-edeae2d40f22 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:36.308344 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e96a93dc-2a6b-46e6-afa1-edeae2d40f22 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:36.308870 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e96a93dc-2a6b-46e6-afa1-edeae2d40f22 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:36.310255 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e96a93dc-2a6b-46e6-afa1-edeae2d40f22 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:36.310764 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e96a93dc-2a6b-46e6-afa1-edeae2d40f22 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:36.441495 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-e96a93dc-2a6b-46e6-afa1-edeae2d40f22 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:36.449137 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-e96a93dc-2a6b-46e6-afa1-edeae2d40f22 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1678 microversion: 2.1 time: 0.151807 May 27 15:18:36.449699 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 255/534] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:36 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:36.583672 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-fe3b6a4c-a16f-4c56-94f8-e4ca8a857760 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:36.584278 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-fe3b6a4c-a16f-4c56-94f8-e4ca8a857760 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:36.590758 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fe3b6a4c-a16f-4c56-94f8-e4ca8a857760 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:36.591889 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fe3b6a4c-a16f-4c56-94f8-e4ca8a857760 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:36.592726 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fe3b6a4c-a16f-4c56-94f8-e4ca8a857760 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:36.593161 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fe3b6a4c-a16f-4c56-94f8-e4ca8a857760 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:36.740221 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-fe3b6a4c-a16f-4c56-94f8-e4ca8a857760 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:36.749499 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-fe3b6a4c-a16f-4c56-94f8-e4ca8a857760 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1757 microversion: 2.1 time: 0.169600 May 27 15:18:36.750096 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 280/535] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:36 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:37.466437 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a8bbbdd1-a18d-4715-865c-14ce51fc5e42 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:37.467103 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a8bbbdd1-a18d-4715-865c-14ce51fc5e42 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:37.473900 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a8bbbdd1-a18d-4715-865c-14ce51fc5e42 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:37.474351 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a8bbbdd1-a18d-4715-865c-14ce51fc5e42 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:37.475146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a8bbbdd1-a18d-4715-865c-14ce51fc5e42 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:37.475588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a8bbbdd1-a18d-4715-865c-14ce51fc5e42 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:37.604881 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a8bbbdd1-a18d-4715-865c-14ce51fc5e42 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:37.613123 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a8bbbdd1-a18d-4715-865c-14ce51fc5e42 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1678 microversion: 2.1 time: 0.151244 May 27 15:18:37.613691 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 256/536] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:37 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:37.767172 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-673b2036-00a0-4ed6-9a0a-aa8c2c1fe5b7 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:37.767720 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-673b2036-00a0-4ed6-9a0a-aa8c2c1fe5b7 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:37.774289 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-673b2036-00a0-4ed6-9a0a-aa8c2c1fe5b7 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:37.774738 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-673b2036-00a0-4ed6-9a0a-aa8c2c1fe5b7 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:37.775530 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-673b2036-00a0-4ed6-9a0a-aa8c2c1fe5b7 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:37.775970 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-673b2036-00a0-4ed6-9a0a-aa8c2c1fe5b7 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:37.921973 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-673b2036-00a0-4ed6-9a0a-aa8c2c1fe5b7 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:37.930180 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-673b2036-00a0-4ed6-9a0a-aa8c2c1fe5b7 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1757 microversion: 2.1 time: 0.167637 May 27 15:18:37.930968 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 281/537] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:37 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:38.630248 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-3edcbef7-0e4c-401e-bbc5-174c5a93e01e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:38.630869 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-3edcbef7-0e4c-401e-bbc5-174c5a93e01e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:38.637363 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3edcbef7-0e4c-401e-bbc5-174c5a93e01e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:38.638332 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3edcbef7-0e4c-401e-bbc5-174c5a93e01e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:38.639134 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3edcbef7-0e4c-401e-bbc5-174c5a93e01e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:38.639576 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3edcbef7-0e4c-401e-bbc5-174c5a93e01e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:38.776568 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-3edcbef7-0e4c-401e-bbc5-174c5a93e01e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:38.784725 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-3edcbef7-0e4c-401e-bbc5-174c5a93e01e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1678 microversion: 2.1 time: 0.158280 May 27 15:18:38.785297 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 257/538] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:38 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:38.947490 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-456deacf-d392-43bc-9bce-5e8836555413 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:38.948093 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-456deacf-d392-43bc-9bce-5e8836555413 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:38.951174 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:38.956517 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-456deacf-d392-43bc-9bce-5e8836555413 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:38.956962 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-456deacf-d392-43bc-9bce-5e8836555413 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:38.957764 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-456deacf-d392-43bc-9bce-5e8836555413 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:38.958199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-456deacf-d392-43bc-9bce-5e8836555413 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:39.102443 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-456deacf-d392-43bc-9bce-5e8836555413 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:39.111320 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-456deacf-d392-43bc-9bce-5e8836555413 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1757 microversion: 2.1 time: 0.167761 May 27 15:18:39.111885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 282/539] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:38 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:39.802101 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-48e8c96c-16c6-449e-8a06-13b2d7571190 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:39.802768 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-48e8c96c-16c6-449e-8a06-13b2d7571190 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:39.805303 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:39.812076 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-48e8c96c-16c6-449e-8a06-13b2d7571190 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:39.812637 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-48e8c96c-16c6-449e-8a06-13b2d7571190 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:39.813443 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-48e8c96c-16c6-449e-8a06-13b2d7571190 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:39.813906 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-48e8c96c-16c6-449e-8a06-13b2d7571190 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:40.129340 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8ecf5c06-7bf9-4a0b-b1e3-feb2559383ac tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:40.130068 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-8ecf5c06-7bf9-4a0b-b1e3-feb2559383ac tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:40.137517 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8ecf5c06-7bf9-4a0b-b1e3-feb2559383ac tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:40.137966 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8ecf5c06-7bf9-4a0b-b1e3-feb2559383ac tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:40.138757 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8ecf5c06-7bf9-4a0b-b1e3-feb2559383ac tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:40.139224 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8ecf5c06-7bf9-4a0b-b1e3-feb2559383ac tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:40.195068 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-48e8c96c-16c6-449e-8a06-13b2d7571190 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:40.202558 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-48e8c96c-16c6-449e-8a06-13b2d7571190 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1678 microversion: 2.1 time: 0.404574 May 27 15:18:40.203162 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 258/540] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:39 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1678 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:40.290008 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-8ecf5c06-7bf9-4a0b-b1e3-feb2559383ac tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:40.298779 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-8ecf5c06-7bf9-4a0b-b1e3-feb2559383ac tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1757 microversion: 2.1 time: 0.173342 May 27 15:18:40.299377 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 283/541] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:40 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:41.007926 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-e2ff2ad2-65da-4a42-9d9f-d395a7c1ab72 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1290341179", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1482917948", "security_groups": [{"name": "tempest-secgroup-smoke-407210975"}], "networks": [{"uuid": "f5a76ff9-642d-44af-a8d5-05876f80cce8"}], "block_device_mapping_v2": [{"uuid": "ebfadd06-c338-42e7-91fa-fc8360208858", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:41.122840 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.network.neutron [None req-e2ff2ad2-65da-4a42-9d9f-d395a7c1ab72 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] validate_networks() for [('f5a76ff9-642d-44af-a8d5-05876f80cce8', None, None, None, None, None)] {{(pid=117743) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:18:41.219783 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-18cf59f1-4892-435b-98cb-554d5097a9d5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:41.220394 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-18cf59f1-4892-435b-98cb-554d5097a9d5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:41.227103 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-18cf59f1-4892-435b-98cb-554d5097a9d5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:41.227807 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-18cf59f1-4892-435b-98cb-554d5097a9d5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:41.228657 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-18cf59f1-4892-435b-98cb-554d5097a9d5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:41.229092 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-18cf59f1-4892-435b-98cb-554d5097a9d5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:41.459089 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-18cf59f1-4892-435b-98cb-554d5097a9d5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:41.468460 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-18cf59f1-4892-435b-98cb-554d5097a9d5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1655 microversion: 2.1 time: 0.253242 May 27 15:18:41.476251 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 284/542] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:41 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1655 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:41.487613 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b4f79903-da00-4579-9e25-e3536747f3bd tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:41.488240 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b4f79903-da00-4579-9e25-e3536747f3bd tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:41.495120 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b4f79903-da00-4579-9e25-e3536747f3bd tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:41.495864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b4f79903-da00-4579-9e25-e3536747f3bd tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:41.496654 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b4f79903-da00-4579-9e25-e3536747f3bd tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:41.497124 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b4f79903-da00-4579-9e25-e3536747f3bd tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:41.641147 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-e2ff2ad2-65da-4a42-9d9f-d395a7c1ab72 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Flavor limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:18:41.641580 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-e2ff2ad2-65da-4a42-9d9f-d395a7c1ab72 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Image limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:18:41.642057 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-e2ff2ad2-65da-4a42-9d9f-d395a7c1ab72 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Flavor pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:18:41.642475 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-e2ff2ad2-65da-4a42-9d9f-d395a7c1ab72 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Image pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:18:41.642908 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-e2ff2ad2-65da-4a42-9d9f-d395a7c1ab72 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:18:41.652027 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e2ff2ad2-65da-4a42-9d9f-d395a7c1ab72 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:41.652481 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e2ff2ad2-65da-4a42-9d9f-d395a7c1ab72 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:41.653456 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e2ff2ad2-65da-4a42-9d9f-d395a7c1ab72 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:41.653900 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e2ff2ad2-65da-4a42-9d9f-d395a7c1ab72 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:41.671896 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-e2ff2ad2-65da-4a42-9d9f-d395a7c1ab72 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Getting quotas for project 520d6685a60d4d9b8b7415d11b01a8f0. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:18:41.676136 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-e2ff2ad2-65da-4a42-9d9f-d395a7c1ab72 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Getting quotas for user f52a9eabb6f84931b8f0af715af9eb36 and project 520d6685a60d4d9b8b7415d11b01a8f0. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:18:41.690519 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b4f79903-da00-4579-9e25-e3536747f3bd tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:41.698755 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b4f79903-da00-4579-9e25-e3536747f3bd tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1757 microversion: 2.1 time: 0.221384 May 27 15:18:41.699371 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 285/543] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:41 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1757 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:41.703880 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-0fbc14b6-b740-4136-856d-ce641b3a893b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:41.709801 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0fbc14b6-b740-4136-856d-ce641b3a893b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:41.710249 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0fbc14b6-b740-4136-856d-ce641b3a893b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:41.733499 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-0fbc14b6-b740-4136-856d-ce641b3a893b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Going to try to start instance {{(pid=117742) start /opt/stack/nova/nova/compute/api.py:2730}} May 27 15:18:41.739337 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-e2ff2ad2-65da-4a42-9d9f-d395a7c1ab72 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Going to run 1 instances... {{(pid=117743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:18:41.741536 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-e2ff2ad2-65da-4a42-9d9f-d395a7c1ab72 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ebfadd06-c338-42e7-91fa-fc8360208858',volume_size=None,volume_type=None)] {{(pid=117743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:18:41.781575 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-0fbc14b6-b740-4136-856d-ce641b3a893b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "POST /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27/action" status: 202 len: 0 microversion: 2.1 time: 0.080838 May 27 15:18:41.785756 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 286/544] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 15:18:41 2022] POST /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:18:41.791595 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-259d8561-83a2-41a2-9a5b-f80c191827b5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:41.792430 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-259d8561-83a2-41a2-9a5b-f80c191827b5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:41.800710 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-259d8561-83a2-41a2-9a5b-f80c191827b5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:41.801328 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-259d8561-83a2-41a2-9a5b-f80c191827b5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:41.802195 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-259d8561-83a2-41a2-9a5b-f80c191827b5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:41.802784 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-259d8561-83a2-41a2-9a5b-f80c191827b5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:41.948915 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-e2ff2ad2-65da-4a42-9d9f-d395a7c1ab72 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.944793 May 27 15:18:41.949797 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 259/545] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 15:18:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:18:41.953664 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-259d8561-83a2-41a2-9a5b-f80c191827b5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:41.956303 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:41.960128 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-85a65b27-6353-418b-b2e3-6a40cd45a95e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:41.960730 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-85a65b27-6353-418b-b2e3-6a40cd45a95e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:41.971456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-259d8561-83a2-41a2-9a5b-f80c191827b5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1664 microversion: 2.1 time: 0.184205 May 27 15:18:41.983187 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 287/546] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:41 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1664 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:42.033065 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-85a65b27-6353-418b-b2e3-6a40cd45a95e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:42.041607 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-85a65b27-6353-418b-b2e3-6a40cd45a95e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1089 microversion: 2.1 time: 0.084891 May 27 15:18:42.044153 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 260/547] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:41 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1089 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:42.717239 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e89d27c2-dd03-46a4-b95b-8c654ebffd07 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:42.717772 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e89d27c2-dd03-46a4-b95b-8c654ebffd07 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:42.725080 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e89d27c2-dd03-46a4-b95b-8c654ebffd07 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:42.725537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e89d27c2-dd03-46a4-b95b-8c654ebffd07 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:42.726299 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e89d27c2-dd03-46a4-b95b-8c654ebffd07 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:42.726740 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e89d27c2-dd03-46a4-b95b-8c654ebffd07 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:42.874600 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-e89d27c2-dd03-46a4-b95b-8c654ebffd07 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:42.882614 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-e89d27c2-dd03-46a4-b95b-8c654ebffd07 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1757 microversion: 2.1 time: 0.170192 May 27 15:18:42.883213 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 288/548] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:42 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:42.989957 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-1d18623f-42fb-4198-96bc-d134c606f9c5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:42.990477 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-1d18623f-42fb-4198-96bc-d134c606f9c5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:42.996670 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1d18623f-42fb-4198-96bc-d134c606f9c5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:42.997118 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1d18623f-42fb-4198-96bc-d134c606f9c5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:42.997881 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1d18623f-42fb-4198-96bc-d134c606f9c5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:42.998334 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1d18623f-42fb-4198-96bc-d134c606f9c5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:43.060663 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8c941076-d0fb-44f8-b50f-67b5deb71b2f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:43.061499 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-8c941076-d0fb-44f8-b50f-67b5deb71b2f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:43.069916 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8c941076-d0fb-44f8-b50f-67b5deb71b2f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:43.070560 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8c941076-d0fb-44f8-b50f-67b5deb71b2f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:43.071550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8c941076-d0fb-44f8-b50f-67b5deb71b2f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:43.072094 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8c941076-d0fb-44f8-b50f-67b5deb71b2f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:43.145146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-8c941076-d0fb-44f8-b50f-67b5deb71b2f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:43.160480 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-1d18623f-42fb-4198-96bc-d134c606f9c5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:43.163103 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-8c941076-d0fb-44f8-b50f-67b5deb71b2f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1187 microversion: 2.1 time: 0.106401 May 27 15:18:43.164009 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 289/549] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:43 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1187 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:43.169957 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-1d18623f-42fb-4198-96bc-d134c606f9c5 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1664 microversion: 2.1 time: 0.183928 May 27 15:18:43.170526 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 261/550] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:42 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1664 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:43.900132 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-10711358-527f-432e-b03a-c0a4b53dfcb6 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:43.900772 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-10711358-527f-432e-b03a-c0a4b53dfcb6 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:43.907713 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-10711358-527f-432e-b03a-c0a4b53dfcb6 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:43.908166 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-10711358-527f-432e-b03a-c0a4b53dfcb6 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:43.908940 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-10711358-527f-432e-b03a-c0a4b53dfcb6 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:43.909377 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-10711358-527f-432e-b03a-c0a4b53dfcb6 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:44.064935 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-10711358-527f-432e-b03a-c0a4b53dfcb6 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:44.073034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-10711358-527f-432e-b03a-c0a4b53dfcb6 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1757 microversion: 2.1 time: 0.176816 May 27 15:18:44.073617 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 290/551] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:43 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:44.180257 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-0f684f97-d77b-4edd-a2a5-b928cbe02b19 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:44.180887 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-0f684f97-d77b-4edd-a2a5-b928cbe02b19 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:44.187347 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-40d27d08-447b-4768-af2d-7ea1aeba3538 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:44.187696 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0f684f97-d77b-4edd-a2a5-b928cbe02b19 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:44.187957 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-40d27d08-447b-4768-af2d-7ea1aeba3538 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:44.188139 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0f684f97-d77b-4edd-a2a5-b928cbe02b19 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:44.188947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0f684f97-d77b-4edd-a2a5-b928cbe02b19 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:44.189380 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0f684f97-d77b-4edd-a2a5-b928cbe02b19 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:44.194560 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-40d27d08-447b-4768-af2d-7ea1aeba3538 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:44.195159 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-40d27d08-447b-4768-af2d-7ea1aeba3538 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:44.195944 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-40d27d08-447b-4768-af2d-7ea1aeba3538 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:44.196481 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-40d27d08-447b-4768-af2d-7ea1aeba3538 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:44.261437 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-0f684f97-d77b-4edd-a2a5-b928cbe02b19 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:44.269407 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-0f684f97-d77b-4edd-a2a5-b928cbe02b19 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1195 microversion: 2.1 time: 0.092918 May 27 15:18:44.270725 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 262/552] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:44 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1195 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:44.351301 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-40d27d08-447b-4768-af2d-7ea1aeba3538 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:44.359804 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-40d27d08-447b-4768-af2d-7ea1aeba3538 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1668 microversion: 2.1 time: 0.176444 May 27 15:18:44.362796 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 291/553] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:44 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1668 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:45.090785 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-dbeaf641-844b-44cb-bc0e-a2b7096d6c22 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:45.091443 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-dbeaf641-844b-44cb-bc0e-a2b7096d6c22 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:45.098088 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-dbeaf641-844b-44cb-bc0e-a2b7096d6c22 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:45.098542 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-dbeaf641-844b-44cb-bc0e-a2b7096d6c22 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:45.099358 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-dbeaf641-844b-44cb-bc0e-a2b7096d6c22 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:45.099808 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-dbeaf641-844b-44cb-bc0e-a2b7096d6c22 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:45.121893 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=100 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:45.256987 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-dbeaf641-844b-44cb-bc0e-a2b7096d6c22 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:45.272372 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-dbeaf641-844b-44cb-bc0e-a2b7096d6c22 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1757 microversion: 2.1 time: 0.185809 May 27 15:18:45.272969 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 263/554] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:45 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:45.286674 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-9d4174b6-b144-4526-b644-f8587928766e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:45.287302 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-9d4174b6-b144-4526-b644-f8587928766e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:45.293693 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9d4174b6-b144-4526-b644-f8587928766e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:45.294137 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9d4174b6-b144-4526-b644-f8587928766e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:45.295479 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9d4174b6-b144-4526-b644-f8587928766e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:45.295898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9d4174b6-b144-4526-b644-f8587928766e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:45.366155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-9d4174b6-b144-4526-b644-f8587928766e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:45.374676 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-9d4174b6-b144-4526-b644-f8587928766e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1205 microversion: 2.1 time: 0.091682 May 27 15:18:45.375515 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 292/555] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:45 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1205 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:46.289672 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-71a8064f-c1f4-40b2-8310-0af504e182c8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:46.290210 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-71a8064f-c1f4-40b2-8310-0af504e182c8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:46.297095 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-71a8064f-c1f4-40b2-8310-0af504e182c8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:46.297630 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-71a8064f-c1f4-40b2-8310-0af504e182c8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:46.298487 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-71a8064f-c1f4-40b2-8310-0af504e182c8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:46.299081 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-71a8064f-c1f4-40b2-8310-0af504e182c8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:46.392480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-880721ab-48ce-455b-8fa9-da6fba5d8650 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:46.393915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-880721ab-48ce-455b-8fa9-da6fba5d8650 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:46.401576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-880721ab-48ce-455b-8fa9-da6fba5d8650 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:46.402243 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-880721ab-48ce-455b-8fa9-da6fba5d8650 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:46.403313 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-880721ab-48ce-455b-8fa9-da6fba5d8650 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:46.404002 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-880721ab-48ce-455b-8fa9-da6fba5d8650 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:46.449129 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-71a8064f-c1f4-40b2-8310-0af504e182c8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:46.458732 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-71a8064f-c1f4-40b2-8310-0af504e182c8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1760 microversion: 2.1 time: 0.173050 May 27 15:18:46.459355 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 264/556] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:46 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1760 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:46.557626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-880721ab-48ce-455b-8fa9-da6fba5d8650 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:46.566481 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-880721ab-48ce-455b-8fa9-da6fba5d8650 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1260 microversion: 2.1 time: 0.178685 May 27 15:18:46.567090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 293/557] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:46 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:46.823895 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-05b71268-d018-4a04-a84a-c225c6928449 req-666609db-8ae2-437e-8041-4b10412c03ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e4355e-ea71-44c5-90ae-0ec0406a5d6e", "tag": "58c057d0-cc07-4dc4-ab97-0024ba4d6dfd"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:46.832472 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-05b71268-d018-4a04-a84a-c225c6928449 req-666609db-8ae2-437e-8041-4b10412c03ab service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:46.833191 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-05b71268-d018-4a04-a84a-c225c6928449 req-666609db-8ae2-437e-8041-4b10412c03ab service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:46.845459 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-05b71268-d018-4a04-a84a-c225c6928449 req-666609db-8ae2-437e-8041-4b10412c03ab service nova] Creating event network-changed:58c057d0-cc07-4dc4-ab97-0024ba4d6dfd for instance 16e4355e-ea71-44c5-90ae-0ec0406a5d6e on hv-cinder-84254 May 27 15:18:46.851744 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-05b71268-d018-4a04-a84a-c225c6928449 req-666609db-8ae2-437e-8041-4b10412c03ab service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031621 May 27 15:18:46.852445 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 265/558] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:18:47.583156 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-5e0c5fc7-1e32-447f-988c-42dfcefd2342 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:47.583849 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-5e0c5fc7-1e32-447f-988c-42dfcefd2342 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:47.590411 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5e0c5fc7-1e32-447f-988c-42dfcefd2342 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:47.590884 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5e0c5fc7-1e32-447f-988c-42dfcefd2342 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:47.592402 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5e0c5fc7-1e32-447f-988c-42dfcefd2342 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:47.592921 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5e0c5fc7-1e32-447f-988c-42dfcefd2342 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:47.722469 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5e0c5fc7-1e32-447f-988c-42dfcefd2342 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:47.730250 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-5e0c5fc7-1e32-447f-988c-42dfcefd2342 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1260 microversion: 2.1 time: 0.150946 May 27 15:18:47.730911 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 294/559] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:47 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:48.747432 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d0bd437d-d170-41d5-8ef7-b6efb8505035 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:48.748199 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-d0bd437d-d170-41d5-8ef7-b6efb8505035 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:48.758693 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d0bd437d-d170-41d5-8ef7-b6efb8505035 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:48.759241 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d0bd437d-d170-41d5-8ef7-b6efb8505035 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:48.760114 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d0bd437d-d170-41d5-8ef7-b6efb8505035 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:48.760643 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d0bd437d-d170-41d5-8ef7-b6efb8505035 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:48.907599 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d0bd437d-d170-41d5-8ef7-b6efb8505035 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:48.915034 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-d0bd437d-d170-41d5-8ef7-b6efb8505035 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1260 microversion: 2.1 time: 0.172349 May 27 15:18:48.915593 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 266/560] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:48 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:49.931889 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-d092f432-de41-4282-b9f1-1d983e59abfb tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:49.932500 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-d092f432-de41-4282-b9f1-1d983e59abfb tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:49.939407 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d092f432-de41-4282-b9f1-1d983e59abfb tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:49.939860 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d092f432-de41-4282-b9f1-1d983e59abfb tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:49.940672 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d092f432-de41-4282-b9f1-1d983e59abfb tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:49.941112 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d092f432-de41-4282-b9f1-1d983e59abfb tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:50.070458 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-d092f432-de41-4282-b9f1-1d983e59abfb tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:50.078771 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-d092f432-de41-4282-b9f1-1d983e59abfb tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1260 microversion: 2.1 time: 0.150750 May 27 15:18:50.079376 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 295/561] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:49 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:51.096380 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-e6207b9f-fa90-4964-87b6-21543b359a9f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:51.097015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-e6207b9f-fa90-4964-87b6-21543b359a9f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:51.103098 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e6207b9f-fa90-4964-87b6-21543b359a9f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:51.103544 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e6207b9f-fa90-4964-87b6-21543b359a9f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:51.104297 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e6207b9f-fa90-4964-87b6-21543b359a9f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:51.104727 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e6207b9f-fa90-4964-87b6-21543b359a9f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:51.239109 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-e6207b9f-fa90-4964-87b6-21543b359a9f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:51.246622 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-e6207b9f-fa90-4964-87b6-21543b359a9f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1260 microversion: 2.1 time: 0.155188 May 27 15:18:51.247220 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 267/562] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:51 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:52.263452 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f19412ca-21f1-4c65-b488-1114abb17324 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:52.264061 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f19412ca-21f1-4c65-b488-1114abb17324 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:52.271021 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f19412ca-21f1-4c65-b488-1114abb17324 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:52.271475 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f19412ca-21f1-4c65-b488-1114abb17324 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:52.272240 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f19412ca-21f1-4c65-b488-1114abb17324 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:52.272675 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f19412ca-21f1-4c65-b488-1114abb17324 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:52.410694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f19412ca-21f1-4c65-b488-1114abb17324 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:52.418181 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f19412ca-21f1-4c65-b488-1114abb17324 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1260 microversion: 2.1 time: 0.158659 May 27 15:18:52.418755 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 296/563] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:52 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:53.435885 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9f72a1d6-885a-4c2d-85af-92a8630591eb tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:53.436534 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9f72a1d6-885a-4c2d-85af-92a8630591eb tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:53.438667 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=2 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:53.439415 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=8 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:18:53.446153 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9f72a1d6-885a-4c2d-85af-92a8630591eb tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:53.446600 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9f72a1d6-885a-4c2d-85af-92a8630591eb tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:53.447403 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9f72a1d6-885a-4c2d-85af-92a8630591eb tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:53.447842 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9f72a1d6-885a-4c2d-85af-92a8630591eb tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:53.577550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9f72a1d6-885a-4c2d-85af-92a8630591eb tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:53.585128 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9f72a1d6-885a-4c2d-85af-92a8630591eb tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1260 microversion: 2.1 time: 0.153190 May 27 15:18:53.585695 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 268/564] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:53 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:54.449155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-dc48975c-98d7-4396-82d5-13af1f51402e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e92d7bd-8685-4a0f-abee-4f1b029e3863", "device": "/dev/sdb"}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:54.450793 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-dc48975c-98d7-4396-82d5-13af1f51402e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: f119703c-9079-4ecb-a5c9-b767c10cacdd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:54.457507 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-dc48975c-98d7-4396-82d5-13af1f51402e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:54.457958 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-dc48975c-98d7-4396-82d5-13af1f51402e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:54.458719 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-dc48975c-98d7-4396-82d5-13af1f51402e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:54.459178 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-dc48975c-98d7-4396-82d5-13af1f51402e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:54.601403 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-40e8ebb6-821a-48a7-b732-e3c88755dcf8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:54.602018 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-40e8ebb6-821a-48a7-b732-e3c88755dcf8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:54.608554 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-40e8ebb6-821a-48a7-b732-e3c88755dcf8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:54.609001 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-40e8ebb6-821a-48a7-b732-e3c88755dcf8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:54.609765 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-40e8ebb6-821a-48a7-b732-e3c88755dcf8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:54.610201 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-40e8ebb6-821a-48a7-b732-e3c88755dcf8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:54.744963 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-40e8ebb6-821a-48a7-b732-e3c88755dcf8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:54.753124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-40e8ebb6-821a-48a7-b732-e3c88755dcf8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1260 microversion: 2.1 time: 0.155558 May 27 15:18:54.753694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 269/565] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:54 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:18:55.294059 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-dc48975c-98d7-4396-82d5-13af1f51402e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "POST /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.848703 May 27 15:18:55.294650 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 297/566] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 15:18:54 2022] POST /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd/os-volume_attachments => generated 194 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:55.769598 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-4b4457e7-407f-4aa2-8ae6-051f90e6424d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:55.770371 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-4b4457e7-407f-4aa2-8ae6-051f90e6424d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:55.776938 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4b4457e7-407f-4aa2-8ae6-051f90e6424d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:55.777393 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4b4457e7-407f-4aa2-8ae6-051f90e6424d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:55.778165 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4b4457e7-407f-4aa2-8ae6-051f90e6424d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:55.778603 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4b4457e7-407f-4aa2-8ae6-051f90e6424d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:55.910306 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-4b4457e7-407f-4aa2-8ae6-051f90e6424d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:55.917813 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-4b4457e7-407f-4aa2-8ae6-051f90e6424d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1260 microversion: 2.1 time: 0.152182 May 27 15:18:55.918376 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 270/567] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:55 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:56.937060 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f9eb6bbe-e0ec-44a6-9b9c-569ef9fea40b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:56.938288 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f9eb6bbe-e0ec-44a6-9b9c-569ef9fea40b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:56.944596 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f9eb6bbe-e0ec-44a6-9b9c-569ef9fea40b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:56.945042 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f9eb6bbe-e0ec-44a6-9b9c-569ef9fea40b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:56.945807 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f9eb6bbe-e0ec-44a6-9b9c-569ef9fea40b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:56.946246 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f9eb6bbe-e0ec-44a6-9b9c-569ef9fea40b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:57.083721 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f9eb6bbe-e0ec-44a6-9b9c-569ef9fea40b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:57.091269 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f9eb6bbe-e0ec-44a6-9b9c-569ef9fea40b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1260 microversion: 2.1 time: 0.159119 May 27 15:18:57.092144 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 298/568] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:56 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:58.108118 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9e346ec6-102d-4147-9863-4ad5a156b1f7 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:58.108729 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9e346ec6-102d-4147-9863-4ad5a156b1f7 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:58.115564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9e346ec6-102d-4147-9863-4ad5a156b1f7 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:58.116015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9e346ec6-102d-4147-9863-4ad5a156b1f7 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:58.116780 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9e346ec6-102d-4147-9863-4ad5a156b1f7 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:58.117217 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9e346ec6-102d-4147-9863-4ad5a156b1f7 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:58.245845 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9e346ec6-102d-4147-9863-4ad5a156b1f7 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:58.253970 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9e346ec6-102d-4147-9863-4ad5a156b1f7 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1260 microversion: 2.1 time: 0.149710 May 27 15:18:58.254540 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 271/569] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:58 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:18:58.582345 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-0f717285-35dc-4fe4-beae-32fb8998d339 req-2a3af96b-5f92-444c-9759-2155ecff1692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e4355e-ea71-44c5-90ae-0ec0406a5d6e", "name": "network-vif-plugged", "status": "completed", "tag": "58c057d0-cc07-4dc4-ab97-0024ba4d6dfd"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:18:58.590969 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-0f717285-35dc-4fe4-beae-32fb8998d339 req-2a3af96b-5f92-444c-9759-2155ecff1692 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:58.591411 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-0f717285-35dc-4fe4-beae-32fb8998d339 req-2a3af96b-5f92-444c-9759-2155ecff1692 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:58.604482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-0f717285-35dc-4fe4-beae-32fb8998d339 req-2a3af96b-5f92-444c-9759-2155ecff1692 service nova] Creating event network-vif-plugged:58c057d0-cc07-4dc4-ab97-0024ba4d6dfd for instance 16e4355e-ea71-44c5-90ae-0ec0406a5d6e on hv-cinder-84254 May 27 15:18:58.609339 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-0f717285-35dc-4fe4-beae-32fb8998d339 req-2a3af96b-5f92-444c-9759-2155ecff1692 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031227 May 27 15:18:58.610244 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 299/570] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:18:59.270936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9efcaae2-b5dc-4815-b9b4-56ce7de5c432 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:18:59.271545 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9efcaae2-b5dc-4815-b9b4-56ce7de5c432 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:18:59.278065 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9efcaae2-b5dc-4815-b9b4-56ce7de5c432 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:59.278520 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9efcaae2-b5dc-4815-b9b4-56ce7de5c432 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:59.279322 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9efcaae2-b5dc-4815-b9b4-56ce7de5c432 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:18:59.279761 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9efcaae2-b5dc-4815-b9b4-56ce7de5c432 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:18:59.409805 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9efcaae2-b5dc-4815-b9b4-56ce7de5c432 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:18:59.417546 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9efcaae2-b5dc-4815-b9b4-56ce7de5c432 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1260 microversion: 2.1 time: 0.150550 May 27 15:18:59.418121 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 272/571] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:18:59 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:00.436553 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-2b636478-5de8-4a03-a706-59c58596ad83 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:00.437244 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-2b636478-5de8-4a03-a706-59c58596ad83 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:00.444543 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2b636478-5de8-4a03-a706-59c58596ad83 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:00.444986 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2b636478-5de8-4a03-a706-59c58596ad83 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:00.445755 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2b636478-5de8-4a03-a706-59c58596ad83 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:00.446188 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2b636478-5de8-4a03-a706-59c58596ad83 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:00.579705 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-2b636478-5de8-4a03-a706-59c58596ad83 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:00.587199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-2b636478-5de8-4a03-a706-59c58596ad83 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1260 microversion: 2.1 time: 0.155425 May 27 15:19:00.587947 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 300/572] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:00 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:01.603676 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-3e6121ca-a116-4c89-9646-f4c8b1c621a4 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:01.604273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-3e6121ca-a116-4c89-9646-f4c8b1c621a4 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:01.610895 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3e6121ca-a116-4c89-9646-f4c8b1c621a4 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:01.611342 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3e6121ca-a116-4c89-9646-f4c8b1c621a4 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:01.612101 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3e6121ca-a116-4c89-9646-f4c8b1c621a4 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:01.612534 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3e6121ca-a116-4c89-9646-f4c8b1c621a4 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:01.742608 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-3e6121ca-a116-4c89-9646-f4c8b1c621a4 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:01.750764 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-3e6121ca-a116-4c89-9646-f4c8b1c621a4 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1445 microversion: 2.1 time: 0.150412 May 27 15:19:01.751375 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 273/573] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:01 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1445 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:01.767184 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b4e49967-5106-4e9e-84c8-95468d785c21 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:01.767794 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b4e49967-5106-4e9e-84c8-95468d785c21 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:01.774317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b4e49967-5106-4e9e-84c8-95468d785c21 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:01.774766 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b4e49967-5106-4e9e-84c8-95468d785c21 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:01.775574 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b4e49967-5106-4e9e-84c8-95468d785c21 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:01.776009 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b4e49967-5106-4e9e-84c8-95468d785c21 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:01.907871 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b4e49967-5106-4e9e-84c8-95468d785c21 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:01.915626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b4e49967-5106-4e9e-84c8-95468d785c21 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1445 microversion: 2.1 time: 0.152898 May 27 15:19:01.916197 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 301/574] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:01 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:03.843023 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-a1eb1fb5-b3f2-4b7d-ba26-1a4b1cd350fa req-a7bfd490-416c-4f5e-84b3-f8605a825ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e4355e-ea71-44c5-90ae-0ec0406a5d6e", "tag": "58c057d0-cc07-4dc4-ab97-0024ba4d6dfd"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:03.853081 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-a1eb1fb5-b3f2-4b7d-ba26-1a4b1cd350fa req-a7bfd490-416c-4f5e-84b3-f8605a825ec8 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:03.853527 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-a1eb1fb5-b3f2-4b7d-ba26-1a4b1cd350fa req-a7bfd490-416c-4f5e-84b3-f8605a825ec8 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:03.866438 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-a1eb1fb5-b3f2-4b7d-ba26-1a4b1cd350fa req-a7bfd490-416c-4f5e-84b3-f8605a825ec8 service nova] Creating event network-changed:58c057d0-cc07-4dc4-ab97-0024ba4d6dfd for instance 16e4355e-ea71-44c5-90ae-0ec0406a5d6e on hv-cinder-84254 May 27 15:19:03.871815 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-a1eb1fb5-b3f2-4b7d-ba26-1a4b1cd350fa req-a7bfd490-416c-4f5e-84b3-f8605a825ec8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032524 May 27 15:19:03.872438 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 274/575] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:18.963165 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-99ee82e9-ad0c-480f-98f6-4e77547baaaa tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:18.963729 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-99ee82e9-ad0c-480f-98f6-4e77547baaaa tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: f119703c-9079-4ecb-a5c9-b767c10cacdd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:18.966430 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=39 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:18.967224 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:18.974006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-99ee82e9-ad0c-480f-98f6-4e77547baaaa tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:18.974448 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-99ee82e9-ad0c-480f-98f6-4e77547baaaa tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:18.975257 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-99ee82e9-ad0c-480f-98f6-4e77547baaaa tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:18.975692 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-99ee82e9-ad0c-480f-98f6-4e77547baaaa tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:19.058298 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.objects.instance [None req-99ee82e9-ad0c-480f-98f6-4e77547baaaa tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lazy-loading 'services' on Instance uuid f119703c-9079-4ecb-a5c9-b767c10cacdd {{(pid=117742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:19:19.131656 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-99ee82e9-ad0c-480f-98f6-4e77547baaaa tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd/os-volume_attachments/1e92d7bd-8685-4a0f-abee-4f1b029e3863" status: 202 len: 0 microversion: 2.1 time: 0.172378 May 27 15:19:19.132246 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 302/576] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 15:19:18 2022] DELETE /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd/os-volume_attachments/1e92d7bd-8685-4a0f-abee-4f1b029e3863 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:19:21.312530 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:21.313357 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=61 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:21.318342 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b650f4f4-4a24-4c5a-81f1-1d128e75ed5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:21.318988 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b650f4f4-4a24-4c5a-81f1-1d128e75ed5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: f119703c-9079-4ecb-a5c9-b767c10cacdd] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:21.326503 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b650f4f4-4a24-4c5a-81f1-1d128e75ed5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:21.326984 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b650f4f4-4a24-4c5a-81f1-1d128e75ed5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:21.327755 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b650f4f4-4a24-4c5a-81f1-1d128e75ed5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:21.328197 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b650f4f4-4a24-4c5a-81f1-1d128e75ed5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:21.354123 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b650f4f4-4a24-4c5a-81f1-1d128e75ed5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: f119703c-9079-4ecb-a5c9-b767c10cacdd] Going to try to terminate instance {{(pid=117743) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:19:21.429162 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b650f4f4-4a24-4c5a-81f1-1d128e75ed5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd" status: 204 len: 0 microversion: 2.1 time: 0.117950 May 27 15:19:21.429892 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 275/577] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:19:21 2022] DELETE /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:19:21.438353 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-bf6faa7a-e077-4fc2-a99b-110132971ac5 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:21.439634 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-bf6faa7a-e077-4fc2-a99b-110132971ac5 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: f119703c-9079-4ecb-a5c9-b767c10cacdd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:21.446636 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bf6faa7a-e077-4fc2-a99b-110132971ac5 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:21.447119 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bf6faa7a-e077-4fc2-a99b-110132971ac5 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:21.447883 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bf6faa7a-e077-4fc2-a99b-110132971ac5 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:21.448315 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bf6faa7a-e077-4fc2-a99b-110132971ac5 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:21.579315 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-bf6faa7a-e077-4fc2-a99b-110132971ac5 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:21.586936 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-bf6faa7a-e077-4fc2-a99b-110132971ac5 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd" status: 200 len: 1513 microversion: 2.1 time: 0.152706 May 27 15:19:21.587554 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 303/578] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:21 2022] GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:22.605396 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-e8fd430c-6c94-4a0d-abcb-fa28e993c248 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:22.606097 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-e8fd430c-6c94-4a0d-abcb-fa28e993c248 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: f119703c-9079-4ecb-a5c9-b767c10cacdd] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:22.612598 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e8fd430c-6c94-4a0d-abcb-fa28e993c248 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:22.613054 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e8fd430c-6c94-4a0d-abcb-fa28e993c248 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:22.613818 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e8fd430c-6c94-4a0d-abcb-fa28e993c248 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:22.614257 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e8fd430c-6c94-4a0d-abcb-fa28e993c248 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:22.741300 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-e8fd430c-6c94-4a0d-abcb-fa28e993c248 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:22.748857 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-e8fd430c-6c94-4a0d-abcb-fa28e993c248 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd" status: 200 len: 1513 microversion: 2.1 time: 0.147786 May 27 15:19:22.749426 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 276/579] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:22 2022] GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:23.765991 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-2748ffb6-ef7e-4ee0-9f00-ae27b4b86a35 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:23.766633 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-2748ffb6-ef7e-4ee0-9f00-ae27b4b86a35 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: f119703c-9079-4ecb-a5c9-b767c10cacdd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:23.773138 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2748ffb6-ef7e-4ee0-9f00-ae27b4b86a35 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:23.773588 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2748ffb6-ef7e-4ee0-9f00-ae27b4b86a35 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:23.774352 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2748ffb6-ef7e-4ee0-9f00-ae27b4b86a35 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:23.774789 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2748ffb6-ef7e-4ee0-9f00-ae27b4b86a35 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:23.909074 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-2748ffb6-ef7e-4ee0-9f00-ae27b4b86a35 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:23.916980 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-2748ffb6-ef7e-4ee0-9f00-ae27b4b86a35 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd" status: 200 len: 1513 microversion: 2.1 time: 0.154814 May 27 15:19:23.917559 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 304/580] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:23 2022] GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:24.339977 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-60f50f77-bec8-4d38-8023-5ef5ae9e0b6f req-a73fbcd6-bee1-4af7-834b-4a5dbc6772ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f119703c-9079-4ecb-a5c9-b767c10cacdd", "name": "network-vif-deleted", "tag": "a844e1cd-316b-4667-aef7-a02995f01389"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:24.349330 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-60f50f77-bec8-4d38-8023-5ef5ae9e0b6f req-a73fbcd6-bee1-4af7-834b-4a5dbc6772ac service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:24.349766 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-60f50f77-bec8-4d38-8023-5ef5ae9e0b6f req-a73fbcd6-bee1-4af7-834b-4a5dbc6772ac service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:24.360608 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-60f50f77-bec8-4d38-8023-5ef5ae9e0b6f req-a73fbcd6-bee1-4af7-834b-4a5dbc6772ac service nova] Creating event network-vif-deleted:a844e1cd-316b-4667-aef7-a02995f01389 for instance f119703c-9079-4ecb-a5c9-b767c10cacdd on hv-cinder-84254 May 27 15:19:24.366355 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-60f50f77-bec8-4d38-8023-5ef5ae9e0b6f req-a73fbcd6-bee1-4af7-834b-4a5dbc6772ac service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029976 May 27 15:19:24.366985 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 277/581] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:24.935813 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-59d18107-aba9-46da-8817-04440842eaf0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:24.936417 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-59d18107-aba9-46da-8817-04440842eaf0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: f119703c-9079-4ecb-a5c9-b767c10cacdd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:24.943915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-59d18107-aba9-46da-8817-04440842eaf0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:24.944361 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-59d18107-aba9-46da-8817-04440842eaf0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:24.945114 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-59d18107-aba9-46da-8817-04440842eaf0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:24.945543 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-59d18107-aba9-46da-8817-04440842eaf0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:24.978085 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-59d18107-aba9-46da-8817-04440842eaf0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:24.978526 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-59d18107-aba9-46da-8817-04440842eaf0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:24.978996 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.objects.instance [None req-59d18107-aba9-46da-8817-04440842eaf0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lazy-loading 'fault' on Instance uuid f119703c-9079-4ecb-a5c9-b767c10cacdd {{(pid=117742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:19:25.020788 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-59d18107-aba9-46da-8817-04440842eaf0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:25.028285 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-59d18107-aba9-46da-8817-04440842eaf0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd" status: 200 len: 1309 microversion: 2.1 time: 0.096297 May 27 15:19:25.028844 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 305/582] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:24 2022] GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:25.767132 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-ecaf141b-36f7-4c43-887c-a72196bdb787 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36e5f894-423a-45b0-bfdc-0e96d179895c"}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:25.768331 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-ecaf141b-36f7-4c43-887c-a72196bdb787 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:25.775263 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ecaf141b-36f7-4c43-887c-a72196bdb787 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:25.775721 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ecaf141b-36f7-4c43-887c-a72196bdb787 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:25.776489 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ecaf141b-36f7-4c43-887c-a72196bdb787 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:25.776932 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ecaf141b-36f7-4c43-887c-a72196bdb787 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:26.046052 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-a8a2e6bf-cb95-4a43-a330-b2a1d9b1b8da tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:26.046655 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-a8a2e6bf-cb95-4a43-a330-b2a1d9b1b8da tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: f119703c-9079-4ecb-a5c9-b767c10cacdd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:26.050551 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-ecaf141b-36f7-4c43-887c-a72196bdb787 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "POST /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288105 May 27 15:19:26.051214 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 278/583] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 15:19:25 2022] POST /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:26.054618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a8a2e6bf-cb95-4a43-a330-b2a1d9b1b8da tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:26.055123 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a8a2e6bf-cb95-4a43-a330-b2a1d9b1b8da tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:26.055888 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a8a2e6bf-cb95-4a43-a330-b2a1d9b1b8da tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:26.056324 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a8a2e6bf-cb95-4a43-a330-b2a1d9b1b8da tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:26.071772 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-a8a2e6bf-cb95-4a43-a330-b2a1d9b1b8da tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] HTTP exception thrown: Instance f119703c-9079-4ecb-a5c9-b767c10cacdd could not be found. May 27 15:19:26.073694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-a8a2e6bf-cb95-4a43-a330-b2a1d9b1b8da tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Request method failure captured: May 27 15:19:26.073694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd HTTP/1.1 May 27 15:19:26.073694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:19:26.073694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:19:26.073694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:19:26.073694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:19:26.073694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:19:26.073694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:19:26.073694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:19:26.073694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:19:26.073694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOu3ZzeJ25CqdOGd2HjdU-YqaOYartue1RUykxBNRS12xMLIGGmp4Ugi1Ly1tUKHPyGAR5rwN2lE7cKGIFk6ECr8rgNzP7pR1Xq9_Rsa-ebfr7HQooIWT7HeSKNyhEAWtd9Y5-aJ31sRrcYZJ-vN7gIBF2af1gQrGvdhAQrI1BzRnS4 May 27 15:19:26.073694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:19:26.073694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:19:26.073694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:19:26.073694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:19:26.073694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:19:26.073694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:19:26.073694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: 58318fdd40dd469099dade09793f6b38 May 27 15:19:26.073694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-VolumesSnapshotTestJSON-926884528 May 27 15:19:26.073694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:19:26.073694 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:19:26.075720 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/58318fdd40dd469099dade09793f6b38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_58318fdd40dd469099dade09793f6b38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/58318fdd40dd469099dade09793f6b38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/58318fdd40dd469099dade09793f6b38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:19:26.075720 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-VolumesSnapshotTestJSON-926884528 May 27 15:19:26.075720 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: 58318fdd40dd469099dade09793f6b38 May 27 15:19:26.075720 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-926884528 May 27 15:19:26.075720 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-VolumesSnapshotTestJSON-926884528-project May 27 15:19:26.075720 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:19:26.075720 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:19:26.075720 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 0b257d6c8a034981be9b54789c313d3c May 27 15:19:26.075720 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-VolumesSnapshotTestJSON-926884528-project May 27 15:19:26.075720 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:19:26.075720 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance f119703c-9079-4ecb-a5c9-b767c10cacdd could not be found. May 27 15:19:26.075720 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': 'f119703c-9079-4ecb-a5c9-b767c10cacdd'} May 27 15:19:26.076736 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:19:26.076736 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:26.076736 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:19:26.076736 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:19:26.076736 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:19:26.076736 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:19:26.076736 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:19:26.076736 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:19:26.076736 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:19:26.076736 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:19:26.076736 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f119703c-9079-4ecb-a5c9-b767c10cacdd could not be found. May 27 15:19:26.076736 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:19:26.076736 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:26.076736 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:19:26.076736 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:26.076736 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:26.076736 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:26.076736 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:19:26.076736 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:19:26.076736 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:19:26.078217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:19:26.078217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:19:26.078217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:19:26.078217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:19:26.078217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:19:26.078217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:19:26.078217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:19:26.078217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f119703c-9079-4ecb-a5c9-b767c10cacdd could not be found. May 27 15:19:26.078217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:19:26.078217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:26.078217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:19:26.078217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:26.078217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:26.078217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:26.078217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:19:26.078217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:19:26.078217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f119703c-9079-4ecb-a5c9-b767c10cacdd could not be found. May 27 15:19:26.078217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:19:26.079429 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-a8a2e6bf-cb95-4a43-a330-b2a1d9b1b8da tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Returning 404 to user: Instance f119703c-9079-4ecb-a5c9-b767c10cacdd could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:19:26.079429 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-a8a2e6bf-cb95-4a43-a330-b2a1d9b1b8da tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd" status: 404 len: 111 microversion: 2.1 time: 0.033711 May 27 15:19:26.079429 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 306/584] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:26 2022] GET /compute/v2.1/servers/f119703c-9079-4ecb-a5c9-b767c10cacdd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:19:35.162930 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-416145a8-6b36-4bb2-a42a-4b195c45c521 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:35.163579 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-416145a8-6b36-4bb2-a42a-4b195c45c521 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:35.169800 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-416145a8-6b36-4bb2-a42a-4b195c45c521 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:35.170245 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-416145a8-6b36-4bb2-a42a-4b195c45c521 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:35.171042 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-416145a8-6b36-4bb2-a42a-4b195c45c521 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:35.171474 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-416145a8-6b36-4bb2-a42a-4b195c45c521 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:35.202338 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-416145a8-6b36-4bb2-a42a-4b195c45c521 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed/os-volume_attachments/3e46c944-c90f-4612-a961-81d33b1b69ed" status: 200 len: 194 microversion: 2.20 time: 0.044761 May 27 15:19:35.202950 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 279/585] 10.222.0.50 () {60 vars in 1453 bytes} [Fri May 27 15:19:35 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed/os-volume_attachments/3e46c944-c90f-4612-a961-81d33b1b69ed => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:19:35.266944 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-9379f3a5-215a-4a4d-a3f0-657b851f16e1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:35.267461 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-9379f3a5-215a-4a4d-a3f0-657b851f16e1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:35.274644 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9379f3a5-215a-4a4d-a3f0-657b851f16e1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:35.275130 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9379f3a5-215a-4a4d-a3f0-657b851f16e1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:35.275898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9379f3a5-215a-4a4d-a3f0-657b851f16e1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:35.276338 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9379f3a5-215a-4a4d-a3f0-657b851f16e1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:35.361208 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.objects.instance [None req-9379f3a5-215a-4a4d-a3f0-657b851f16e1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lazy-loading 'services' on Instance uuid b88bbd4b-d173-4df5-9e19-4fedb81b4aed {{(pid=117742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:19:35.433824 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-9379f3a5-215a-4a4d-a3f0-657b851f16e1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed/os-volume_attachments/3e46c944-c90f-4612-a961-81d33b1b69ed" status: 202 len: 0 microversion: 2.20 time: 0.170739 May 27 15:19:35.434405 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 307/586] 10.222.0.50 () {60 vars in 1456 bytes} [Fri May 27 15:19:35 2022] DELETE /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed/os-volume_attachments/3e46c944-c90f-4612-a961-81d33b1b69ed => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 15:19:35.443574 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-5f50b16d-910f-4a93-80d5-bd8917e60523 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:35.444549 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-5f50b16d-910f-4a93-80d5-bd8917e60523 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:35.451159 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5f50b16d-910f-4a93-80d5-bd8917e60523 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:35.451612 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5f50b16d-910f-4a93-80d5-bd8917e60523 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:35.452373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5f50b16d-910f-4a93-80d5-bd8917e60523 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:35.452807 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5f50b16d-910f-4a93-80d5-bd8917e60523 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:35.483220 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-5f50b16d-910f-4a93-80d5-bd8917e60523 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044312 May 27 15:19:35.483779 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 280/587] 10.222.0.50 () {60 vars in 1342 bytes} [Fri May 27 15:19:35 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:19:35.979048 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-7d1c0dac-e25f-4567-93cd-0f21b956bb96 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1500699719", "imageRef": "a9407644-1f68-43e6-beb1-ce2085766180", "flavorRef": "452", "networks": [{"uuid": "684e0bf0-9400-4ba4-8588-2b0594157e55"}]}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:36.029783 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.network.neutron [None req-7d1c0dac-e25f-4567-93cd-0f21b956bb96 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] validate_networks() for [('684e0bf0-9400-4ba4-8588-2b0594157e55', None, None, None, None, None)] {{(pid=117742) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:19:36.388924 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-7d1c0dac-e25f-4567-93cd-0f21b956bb96 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Flavor limits 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:19:36.389488 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-7d1c0dac-e25f-4567-93cd-0f21b956bb96 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Image limits 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:19:36.389795 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-7d1c0dac-e25f-4567-93cd-0f21b956bb96 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Flavor pref 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:19:36.390194 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-7d1c0dac-e25f-4567-93cd-0f21b956bb96 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Image pref 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:19:36.390599 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-7d1c0dac-e25f-4567-93cd-0f21b956bb96 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:19:36.400018 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7d1c0dac-e25f-4567-93cd-0f21b956bb96 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:36.400461 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7d1c0dac-e25f-4567-93cd-0f21b956bb96 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:36.401243 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7d1c0dac-e25f-4567-93cd-0f21b956bb96 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:36.401670 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7d1c0dac-e25f-4567-93cd-0f21b956bb96 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:36.418599 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-7d1c0dac-e25f-4567-93cd-0f21b956bb96 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Getting quotas for project 58318fdd40dd469099dade09793f6b38. Resources: {'cores', 'ram', 'instances'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:19:36.422606 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-7d1c0dac-e25f-4567-93cd-0f21b956bb96 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Getting quotas for user 0b257d6c8a034981be9b54789c313d3c and project 58318fdd40dd469099dade09793f6b38. Resources: {'cores', 'ram', 'instances'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:19:36.433363 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-7d1c0dac-e25f-4567-93cd-0f21b956bb96 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Going to run 1 instances... {{(pid=117742) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:19:36.435725 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-7d1c0dac-e25f-4567-93cd-0f21b956bb96 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9407644-1f68-43e6-beb1-ce2085766180',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117742) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:19:36.480093 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-7d1c0dac-e25f-4567-93cd-0f21b956bb96 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505353 May 27 15:19:36.480734 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 308/588] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 15:19:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 15:19:36.491685 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-66491a87-dd8f-4c7e-983d-c40dc4c4a192 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:36.492404 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-66491a87-dd8f-4c7e-983d-c40dc4c4a192 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:36.495125 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ac743359-30d2-450b-9a5d-a6beaa51170a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:36.496169 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ac743359-30d2-450b-9a5d-a6beaa51170a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:36.504260 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ac743359-30d2-450b-9a5d-a6beaa51170a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:36.504711 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ac743359-30d2-450b-9a5d-a6beaa51170a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:36.505476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ac743359-30d2-450b-9a5d-a6beaa51170a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:36.505904 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ac743359-30d2-450b-9a5d-a6beaa51170a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:36.537567 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ac743359-30d2-450b-9a5d-a6beaa51170a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046344 May 27 15:19:36.538469 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 309/589] 10.222.0.50 () {60 vars in 1342 bytes} [Fri May 27 15:19:36 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 15:19:36.555793 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-66491a87-dd8f-4c7e-983d-c40dc4c4a192 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:36.562360 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-66491a87-dd8f-4c7e-983d-c40dc4c4a192 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1" status: 200 len: 1219 microversion: 2.1 time: 0.075584 May 27 15:19:36.562957 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 281/590] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:36 2022] GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:36.727824 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-17b96771-9637-4f8b-a253-25920f0860c8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:36.728793 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-17b96771-9637-4f8b-a253-25920f0860c8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:36.735086 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-17b96771-9637-4f8b-a253-25920f0860c8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:36.735548 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-17b96771-9637-4f8b-a253-25920f0860c8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:36.736324 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-17b96771-9637-4f8b-a253-25920f0860c8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:36.737361 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-17b96771-9637-4f8b-a253-25920f0860c8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:36.761239 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.objects.instance [None req-17b96771-9637-4f8b-a253-25920f0860c8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lazy-loading 'flavor' on Instance uuid 5b91f595-1d49-4eed-8d8c-57bb287d34b5 {{(pid=117742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:19:36.892433 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-17b96771-9637-4f8b-a253-25920f0860c8 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "POST /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5/action" status: 200 len: 32 microversion: 2.1 time: 0.168741 May 27 15:19:36.893012 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 310/591] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 15:19:36 2022] POST /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:19:36.902292 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-416a2a36-a223-424a-a52b-9cb3f36ea909 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:36.902991 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-416a2a36-a223-424a-a52b-9cb3f36ea909 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:36.909528 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-416a2a36-a223-424a-a52b-9cb3f36ea909 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:36.909979 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-416a2a36-a223-424a-a52b-9cb3f36ea909 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:36.910758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-416a2a36-a223-424a-a52b-9cb3f36ea909 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:36.911236 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-416a2a36-a223-424a-a52b-9cb3f36ea909 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:37.047232 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-416a2a36-a223-424a-a52b-9cb3f36ea909 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:37.056795 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-416a2a36-a223-424a-a52b-9cb3f36ea909 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1735 microversion: 2.1 time: 0.158227 May 27 15:19:37.057538 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 282/592] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:36 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:37.550860 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-dcdd3e64-394c-4eab-a3d5-528d01fb5f62 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:37.552458 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-dcdd3e64-394c-4eab-a3d5-528d01fb5f62 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:37.558823 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-dcdd3e64-394c-4eab-a3d5-528d01fb5f62 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:37.559304 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-dcdd3e64-394c-4eab-a3d5-528d01fb5f62 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:37.560083 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-dcdd3e64-394c-4eab-a3d5-528d01fb5f62 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:37.560520 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-dcdd3e64-394c-4eab-a3d5-528d01fb5f62 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:37.580090 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-8c9ebb7f-c84c-47c8-9e60-5a940f91bdb3 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:37.582111 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-8c9ebb7f-c84c-47c8-9e60-5a940f91bdb3 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:37.588577 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8c9ebb7f-c84c-47c8-9e60-5a940f91bdb3 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:37.589262 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8c9ebb7f-c84c-47c8-9e60-5a940f91bdb3 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:37.590203 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8c9ebb7f-c84c-47c8-9e60-5a940f91bdb3 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:37.590792 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8c9ebb7f-c84c-47c8-9e60-5a940f91bdb3 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:37.597819 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-dcdd3e64-394c-4eab-a3d5-528d01fb5f62 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051909 May 27 15:19:37.598599 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 311/593] 10.222.0.50 () {60 vars in 1342 bytes} [Fri May 27 15:19:37 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 15:19:37.657641 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-8c9ebb7f-c84c-47c8-9e60-5a940f91bdb3 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:37.666767 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-8c9ebb7f-c84c-47c8-9e60-5a940f91bdb3 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1" status: 200 len: 1271 microversion: 2.1 time: 0.090487 May 27 15:19:37.668089 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 283/594] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:37 2022] GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:38.073647 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-4f24d62f-0269-4c34-95a1-921fab24de7a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:38.074283 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-4f24d62f-0269-4c34-95a1-921fab24de7a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:38.080838 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4f24d62f-0269-4c34-95a1-921fab24de7a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:38.081369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4f24d62f-0269-4c34-95a1-921fab24de7a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:38.082164 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4f24d62f-0269-4c34-95a1-921fab24de7a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:38.082605 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4f24d62f-0269-4c34-95a1-921fab24de7a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:38.219860 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-4f24d62f-0269-4c34-95a1-921fab24de7a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:38.228213 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-4f24d62f-0269-4c34-95a1-921fab24de7a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1735 microversion: 2.1 time: 0.158598 May 27 15:19:38.228796 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 312/595] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:38 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:38.609903 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a47331e6-3abb-48a0-ad04-971d6cd28d36 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:38.610888 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a47331e6-3abb-48a0-ad04-971d6cd28d36 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:38.618151 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a47331e6-3abb-48a0-ad04-971d6cd28d36 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:38.618601 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a47331e6-3abb-48a0-ad04-971d6cd28d36 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:38.619408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a47331e6-3abb-48a0-ad04-971d6cd28d36 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:38.619842 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a47331e6-3abb-48a0-ad04-971d6cd28d36 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:38.650392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a47331e6-3abb-48a0-ad04-971d6cd28d36 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044677 May 27 15:19:38.650979 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 284/596] 10.222.0.50 () {60 vars in 1342 bytes} [Fri May 27 15:19:38 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:38.686036 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-42d1bb3d-4563-44a9-863d-249a4c034039 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:38.687041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-42d1bb3d-4563-44a9-863d-249a4c034039 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:38.693977 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-42d1bb3d-4563-44a9-863d-249a4c034039 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:38.694430 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-42d1bb3d-4563-44a9-863d-249a4c034039 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:38.695241 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-42d1bb3d-4563-44a9-863d-249a4c034039 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:38.695681 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-42d1bb3d-4563-44a9-863d-249a4c034039 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:38.715053 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-888b33bd-6ea2-44d9-910e-26c2e8d9212b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:38.715762 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-888b33bd-6ea2-44d9-910e-26c2e8d9212b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:38.723139 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-888b33bd-6ea2-44d9-910e-26c2e8d9212b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:38.723784 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-888b33bd-6ea2-44d9-910e-26c2e8d9212b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:38.724709 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-888b33bd-6ea2-44d9-910e-26c2e8d9212b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:38.725138 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-888b33bd-6ea2-44d9-910e-26c2e8d9212b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:38.753768 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-888b33bd-6ea2-44d9-910e-26c2e8d9212b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Going to try to terminate instance {{(pid=117743) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:19:38.834881 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-888b33bd-6ea2-44d9-910e-26c2e8d9212b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 204 len: 0 microversion: 2.20 time: 0.123410 May 27 15:19:38.839348 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 285/597] 10.222.0.50 () {60 vars in 1279 bytes} [Fri May 27 15:19:38 2022] DELETE /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 27 15:19:38.845390 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f9589717-30d3-4057-8fe5-076cbce91097 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:38.846439 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-f9589717-30d3-4057-8fe5-076cbce91097 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:38.852644 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f9589717-30d3-4057-8fe5-076cbce91097 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:38.853180 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f9589717-30d3-4057-8fe5-076cbce91097 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:38.854015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f9589717-30d3-4057-8fe5-076cbce91097 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:38.854793 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f9589717-30d3-4057-8fe5-076cbce91097 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:38.858335 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-42d1bb3d-4563-44a9-863d-249a4c034039 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:38.866855 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-42d1bb3d-4563-44a9-863d-249a4c034039 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1" status: 200 len: 1319 microversion: 2.1 time: 0.185152 May 27 15:19:38.867690 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 313/598] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:38 2022] GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:38.991621 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f9589717-30d3-4057-8fe5-076cbce91097 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:38.999730 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f9589717-30d3-4057-8fe5-076cbce91097 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:39.001291 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f9589717-30d3-4057-8fe5-076cbce91097 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:39.002445 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-f9589717-30d3-4057-8fe5-076cbce91097 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1721 microversion: 2.20 time: 0.161596 May 27 15:19:39.003032 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 286/599] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:19:38 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:39.245393 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-c17812f0-5edd-4359-9073-fde46f94a4c9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:39.245987 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-c17812f0-5edd-4359-9073-fde46f94a4c9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:39.252003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c17812f0-5edd-4359-9073-fde46f94a4c9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:39.252946 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c17812f0-5edd-4359-9073-fde46f94a4c9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:39.253698 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c17812f0-5edd-4359-9073-fde46f94a4c9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:39.254130 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c17812f0-5edd-4359-9073-fde46f94a4c9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:39.374666 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-ce5b5cdc-6f16-42c6-ae5b-e776ca628873 req-ec9aaeff-a575-4dcb-9da7-f98e5084d292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1", "tag": "43619b86-23d3-4ddb-85d5-c69b05a310f0"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:39.384433 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-ce5b5cdc-6f16-42c6-ae5b-e776ca628873 req-ec9aaeff-a575-4dcb-9da7-f98e5084d292 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:39.384884 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-ce5b5cdc-6f16-42c6-ae5b-e776ca628873 req-ec9aaeff-a575-4dcb-9da7-f98e5084d292 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:39.395050 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-c17812f0-5edd-4359-9073-fde46f94a4c9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:39.398189 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-ce5b5cdc-6f16-42c6-ae5b-e776ca628873 req-ec9aaeff-a575-4dcb-9da7-f98e5084d292 service nova] Creating event network-changed:43619b86-23d3-4ddb-85d5-c69b05a310f0 for instance 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 on hv-cinder-84254 May 27 15:19:39.404137 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-ce5b5cdc-6f16-42c6-ae5b-e776ca628873 req-ec9aaeff-a575-4dcb-9da7-f98e5084d292 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033370 May 27 15:19:39.411579 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-c17812f0-5edd-4359-9073-fde46f94a4c9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1735 microversion: 2.1 time: 0.169953 May 27 15:19:39.412801 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 314/600] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:39 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:39.415770 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 287/601] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:19:39.884202 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b71dd8b2-3dc5-4d20-86e4-5a81bca9106b tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:39.884861 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b71dd8b2-3dc5-4d20-86e4-5a81bca9106b tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:39.891344 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b71dd8b2-3dc5-4d20-86e4-5a81bca9106b tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:39.891789 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b71dd8b2-3dc5-4d20-86e4-5a81bca9106b tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:39.892543 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b71dd8b2-3dc5-4d20-86e4-5a81bca9106b tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:39.893614 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b71dd8b2-3dc5-4d20-86e4-5a81bca9106b tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:40.023166 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-39fdf997-2bb9-41e6-8b14-df40b55a241f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:40.023944 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-39fdf997-2bb9-41e6-8b14-df40b55a241f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:40.024420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b71dd8b2-3dc5-4d20-86e4-5a81bca9106b tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:40.030357 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-39fdf997-2bb9-41e6-8b14-df40b55a241f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:40.030902 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-39fdf997-2bb9-41e6-8b14-df40b55a241f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:40.031736 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-39fdf997-2bb9-41e6-8b14-df40b55a241f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:40.031954 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b71dd8b2-3dc5-4d20-86e4-5a81bca9106b tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1" status: 200 len: 1319 microversion: 2.1 time: 0.151715 May 27 15:19:40.032365 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-39fdf997-2bb9-41e6-8b14-df40b55a241f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:40.032557 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 315/602] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:39 2022] GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:40.163866 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-39fdf997-2bb9-41e6-8b14-df40b55a241f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:40.171698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-39fdf997-2bb9-41e6-8b14-df40b55a241f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:40.173197 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-39fdf997-2bb9-41e6-8b14-df40b55a241f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:40.174340 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-39fdf997-2bb9-41e6-8b14-df40b55a241f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1721 microversion: 2.20 time: 0.156959 May 27 15:19:40.174911 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 288/603] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:19:40 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:19:40.429898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-bb902e96-e95e-40fa-a6ec-2634eaa440e9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:40.430422 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-bb902e96-e95e-40fa-a6ec-2634eaa440e9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:40.436420 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bb902e96-e95e-40fa-a6ec-2634eaa440e9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:40.436860 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bb902e96-e95e-40fa-a6ec-2634eaa440e9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:40.437605 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bb902e96-e95e-40fa-a6ec-2634eaa440e9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:40.438035 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bb902e96-e95e-40fa-a6ec-2634eaa440e9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:40.443411 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:40.571983 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-bb902e96-e95e-40fa-a6ec-2634eaa440e9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:40.579867 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-bb902e96-e95e-40fa-a6ec-2634eaa440e9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1735 microversion: 2.1 time: 0.153932 May 27 15:19:40.580751 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 316/604] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:40 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:41.049285 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f973ca35-d151-4829-a21e-c16e46ae2c0f tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:41.050015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-f973ca35-d151-4829-a21e-c16e46ae2c0f tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:41.056603 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f973ca35-d151-4829-a21e-c16e46ae2c0f tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:41.057109 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f973ca35-d151-4829-a21e-c16e46ae2c0f tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:41.057869 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f973ca35-d151-4829-a21e-c16e46ae2c0f tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:41.058297 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f973ca35-d151-4829-a21e-c16e46ae2c0f tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:41.062356 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:41.192552 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b0460e3f-5a4c-4299-b374-a9188fa0c859 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:41.193438 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b0460e3f-5a4c-4299-b374-a9188fa0c859 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:41.196123 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f973ca35-d151-4829-a21e-c16e46ae2c0f tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:41.199721 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b0460e3f-5a4c-4299-b374-a9188fa0c859 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:41.200165 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b0460e3f-5a4c-4299-b374-a9188fa0c859 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:41.200929 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b0460e3f-5a4c-4299-b374-a9188fa0c859 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:41.201366 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b0460e3f-5a4c-4299-b374-a9188fa0c859 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:41.203607 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-f973ca35-d151-4829-a21e-c16e46ae2c0f tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1" status: 200 len: 1319 microversion: 2.1 time: 0.158224 May 27 15:19:41.204121 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 289/605] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:41 2022] GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:41.336394 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b0460e3f-5a4c-4299-b374-a9188fa0c859 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:41.349677 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b0460e3f-5a4c-4299-b374-a9188fa0c859 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:41.351240 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b0460e3f-5a4c-4299-b374-a9188fa0c859 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:41.352416 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b0460e3f-5a4c-4299-b374-a9188fa0c859 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1721 microversion: 2.20 time: 0.164201 May 27 15:19:41.355549 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 317/606] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:19:41 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:41.598322 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9294f8b2-40cb-4a0a-9f0b-ada651d08fea tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:41.598955 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9294f8b2-40cb-4a0a-9f0b-ada651d08fea tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:41.605013 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9294f8b2-40cb-4a0a-9f0b-ada651d08fea tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:41.605468 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9294f8b2-40cb-4a0a-9f0b-ada651d08fea tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:41.606231 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9294f8b2-40cb-4a0a-9f0b-ada651d08fea tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:41.606665 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9294f8b2-40cb-4a0a-9f0b-ada651d08fea tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:41.787627 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9294f8b2-40cb-4a0a-9f0b-ada651d08fea tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:41.796254 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9294f8b2-40cb-4a0a-9f0b-ada651d08fea tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1735 microversion: 2.1 time: 0.202503 May 27 15:19:41.796763 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 290/607] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:41 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:42.221922 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f122b04a-d5c6-4cd7-8c5b-9c319d737222 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:42.222653 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f122b04a-d5c6-4cd7-8c5b-9c319d737222 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:42.230115 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f122b04a-d5c6-4cd7-8c5b-9c319d737222 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:42.230643 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f122b04a-d5c6-4cd7-8c5b-9c319d737222 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:42.231535 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f122b04a-d5c6-4cd7-8c5b-9c319d737222 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:42.231976 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f122b04a-d5c6-4cd7-8c5b-9c319d737222 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:42.373609 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-35c66cdf-f555-48ac-8e40-def435bb1339 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:42.375370 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-35c66cdf-f555-48ac-8e40-def435bb1339 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:42.384180 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-35c66cdf-f555-48ac-8e40-def435bb1339 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:42.385583 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-35c66cdf-f555-48ac-8e40-def435bb1339 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:42.390756 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-35c66cdf-f555-48ac-8e40-def435bb1339 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:42.391777 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-35c66cdf-f555-48ac-8e40-def435bb1339 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:42.440218 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f122b04a-d5c6-4cd7-8c5b-9c319d737222 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:42.448119 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f122b04a-d5c6-4cd7-8c5b-9c319d737222 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1" status: 200 len: 1319 microversion: 2.1 time: 0.230795 May 27 15:19:42.450057 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 318/608] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:42 2022] GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:42.480402 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-35c66cdf-f555-48ac-8e40-def435bb1339 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:42.489229 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-35c66cdf-f555-48ac-8e40-def435bb1339 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:42.491112 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-35c66cdf-f555-48ac-8e40-def435bb1339 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:42.492270 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-35c66cdf-f555-48ac-8e40-def435bb1339 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1654 microversion: 2.20 time: 0.124684 May 27 15:19:42.492830 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 291/609] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:19:42 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1654 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:19:42.517113 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-e7b1022c-4c65-43e8-9292-1c51bedf4e4c req-42a3a5c8-f714-4e55-b411-bbeee29dc79a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b88bbd4b-d173-4df5-9e19-4fedb81b4aed", "name": "network-vif-deleted", "tag": "b65a7130-71a7-4267-9201-c07ec8e83b00"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:42.526361 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-e7b1022c-4c65-43e8-9292-1c51bedf4e4c req-42a3a5c8-f714-4e55-b411-bbeee29dc79a service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:42.526951 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-e7b1022c-4c65-43e8-9292-1c51bedf4e4c req-42a3a5c8-f714-4e55-b411-bbeee29dc79a service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:42.538771 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-e7b1022c-4c65-43e8-9292-1c51bedf4e4c req-42a3a5c8-f714-4e55-b411-bbeee29dc79a service nova] Creating event network-vif-deleted:b65a7130-71a7-4267-9201-c07ec8e83b00 for instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed on hv-cinder-84254 May 27 15:19:42.544056 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-e7b1022c-4c65-43e8-9292-1c51bedf4e4c req-42a3a5c8-f714-4e55-b411-bbeee29dc79a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030501 May 27 15:19:42.544933 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 319/610] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:42.813501 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f6b987cd-1be3-4104-8dfe-97cff31e82b2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:42.814113 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-f6b987cd-1be3-4104-8dfe-97cff31e82b2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:42.821144 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f6b987cd-1be3-4104-8dfe-97cff31e82b2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:42.821798 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f6b987cd-1be3-4104-8dfe-97cff31e82b2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:42.822672 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f6b987cd-1be3-4104-8dfe-97cff31e82b2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:42.823239 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f6b987cd-1be3-4104-8dfe-97cff31e82b2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:42.954781 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f6b987cd-1be3-4104-8dfe-97cff31e82b2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:42.963401 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-f6b987cd-1be3-4104-8dfe-97cff31e82b2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1735 microversion: 2.1 time: 0.153782 May 27 15:19:42.964075 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 292/611] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:42 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:43.466550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f8281c2b-d79b-4c17-9bb4-692f5e2aed5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:43.467930 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f8281c2b-d79b-4c17-9bb4-692f5e2aed5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:43.476148 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f8281c2b-d79b-4c17-9bb4-692f5e2aed5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:43.476495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f8281c2b-d79b-4c17-9bb4-692f5e2aed5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:43.477260 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f8281c2b-d79b-4c17-9bb4-692f5e2aed5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:43.477690 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f8281c2b-d79b-4c17-9bb4-692f5e2aed5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:43.511380 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9668f5dd-f37f-462a-af46-937c092449b6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:43.512835 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9668f5dd-f37f-462a-af46-937c092449b6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:43.520997 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9668f5dd-f37f-462a-af46-937c092449b6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:43.521660 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9668f5dd-f37f-462a-af46-937c092449b6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:43.522885 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9668f5dd-f37f-462a-af46-937c092449b6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:43.523610 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9668f5dd-f37f-462a-af46-937c092449b6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:43.561372 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9668f5dd-f37f-462a-af46-937c092449b6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:43.562184 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9668f5dd-f37f-462a-af46-937c092449b6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:43.562946 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.objects.instance [None req-9668f5dd-f37f-462a-af46-937c092449b6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lazy-loading 'fault' on Instance uuid b88bbd4b-d173-4df5-9e19-4fedb81b4aed {{(pid=117743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:19:43.629496 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9668f5dd-f37f-462a-af46-937c092449b6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:43.637716 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9668f5dd-f37f-462a-af46-937c092449b6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:43.639253 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9668f5dd-f37f-462a-af46-937c092449b6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:43.640425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9668f5dd-f37f-462a-af46-937c092449b6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 200 len: 1371 microversion: 2.20 time: 0.133084 May 27 15:19:43.641355 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 293/612] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:19:43 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 1371 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:43.663919 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f8281c2b-d79b-4c17-9bb4-692f5e2aed5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:43.672075 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f8281c2b-d79b-4c17-9bb4-692f5e2aed5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1" status: 200 len: 1319 microversion: 2.1 time: 0.210112 May 27 15:19:43.672680 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 320/613] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:43 2022] GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:43.981886 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-08b073ca-4dd0-4481-b015-93de625699a0 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:43.983047 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-08b073ca-4dd0-4481-b015-93de625699a0 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:43.990396 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-08b073ca-4dd0-4481-b015-93de625699a0 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:43.991777 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-08b073ca-4dd0-4481-b015-93de625699a0 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:43.993018 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-08b073ca-4dd0-4481-b015-93de625699a0 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:43.993655 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-08b073ca-4dd0-4481-b015-93de625699a0 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:44.156210 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-08b073ca-4dd0-4481-b015-93de625699a0 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:44.166504 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-08b073ca-4dd0-4481-b015-93de625699a0 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1735 microversion: 2.1 time: 0.188784 May 27 15:19:44.170907 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 294/614] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:43 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:44.659401 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-cd5ac3c7-e799-4dd6-b7d7-8c98de9e2ff5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:44.659950 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-cd5ac3c7-e799-4dd6-b7d7-8c98de9e2ff5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:44.666626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-cd5ac3c7-e799-4dd6-b7d7-8c98de9e2ff5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:44.667117 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-cd5ac3c7-e799-4dd6-b7d7-8c98de9e2ff5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:44.667882 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-cd5ac3c7-e799-4dd6-b7d7-8c98de9e2ff5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:44.668318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-cd5ac3c7-e799-4dd6-b7d7-8c98de9e2ff5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:44.681548 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-cd5ac3c7-e799-4dd6-b7d7-8c98de9e2ff5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] HTTP exception thrown: Instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed could not be found. May 27 15:19:44.683204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-cd5ac3c7-e799-4dd6-b7d7-8c98de9e2ff5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Request method failure captured: May 27 15:19:44.683204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed HTTP/1.1 May 27 15:19:44.683204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:19:44.683204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:19:44.683204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:19:44.683204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:19:44.683204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:19:44.683204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:19:44.683204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:19:44.683204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:19:44.683204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOryEvQW80jWw1BZQMtbEkYLzK31YlVi3G6VuQOJnB0o-s9mBgStL9hmb9atC4oxGVdIybXz1gW4wa77rCeQAOi_6xwCsR2sej6oCIC1cnK4jyw8gKmGRMxNtBlLOvmE0u3MTICzL7-TNerkVLiaGqwQVyVoHc8mq4nwttC2Ay0qkTI May 27 15:19:44.683204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:19:44.683204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:19:44.683204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:19:44.683204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:19:44.683204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Openstack-Nova-Api-Version: 2.20 May 27 15:19:44.683204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:19:44.683204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:19:44.683204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: f20b51981801495aacd31a56e87d0e3c May 27 15:19:44.683204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-516093280 May 27 15:19:44.683204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:19:44.683204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:19:44.684649 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:19:44.684649 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-AttachVolumeShelveTestJSON-516093280 May 27 15:19:44.684649 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: f20b51981801495aacd31a56e87d0e3c May 27 15:19:44.684649 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-516093280 May 27 15:19:44.684649 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-AttachVolumeShelveTestJSON-516093280-project May 27 15:19:44.684649 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:19:44.684649 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:19:44.684649 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 5a990918de6d409a949616da90de6a5e May 27 15:19:44.684649 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-AttachVolumeShelveTestJSON-516093280-project May 27 15:19:44.684649 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:19:44.684649 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed could not be found. May 27 15:19:44.684649 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': 'b88bbd4b-d173-4df5-9e19-4fedb81b4aed'} May 27 15:19:44.685576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:19:44.685576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:44.685576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:19:44.685576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:19:44.685576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:19:44.685576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:19:44.685576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:19:44.685576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:19:44.685576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:19:44.685576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:19:44.685576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed could not be found. May 27 15:19:44.685576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:19:44.685576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:44.685576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:19:44.685576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:44.685576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:44.685576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:44.685576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:19:44.685576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:19:44.685576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:19:44.687069 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:19:44.687069 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:19:44.687069 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:19:44.687069 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:19:44.687069 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:19:44.687069 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:19:44.687069 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:19:44.687069 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed could not be found. May 27 15:19:44.687069 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:19:44.687069 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:44.687069 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:19:44.687069 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:44.687069 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:44.687069 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:44.687069 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:19:44.687069 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:19:44.687069 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed could not be found. May 27 15:19:44.687069 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:19:44.688351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-cd5ac3c7-e799-4dd6-b7d7-8c98de9e2ff5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Returning 404 to user: Instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:19:44.688351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-cd5ac3c7-e799-4dd6-b7d7-8c98de9e2ff5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 404 len: 111 microversion: 2.20 time: 0.029173 May 27 15:19:44.688659 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 321/615] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:19:44 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:19:44.693571 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-0634a678-d411-4a80-80e1-2f67398034f0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:44.694041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-682d2fcf-04c6-4318-a844-4bf178e02463 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '.version_select at 0x7f57e1827040>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:44.694381 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-0634a678-d411-4a80-80e1-2f67398034f0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:44.702160 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0634a678-d411-4a80-80e1-2f67398034f0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:44.702769 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0634a678-d411-4a80-80e1-2f67398034f0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:44.703653 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0634a678-d411-4a80-80e1-2f67398034f0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:44.704182 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0634a678-d411-4a80-80e1-2f67398034f0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:44.713934 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-682d2fcf-04c6-4318-a844-4bf178e02463 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-312635310" status: 204 len: 0 microversion: 2.20 time: 0.024252 May 27 15:19:44.714899 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 322/616] 10.222.0.50 () {60 vars in 1258 bytes} [Fri May 27 15:19:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-312635310 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:19:44.905306 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-0634a678-d411-4a80-80e1-2f67398034f0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:44.928068 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-0634a678-d411-4a80-80e1-2f67398034f0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1" status: 200 len: 1319 microversion: 2.1 time: 0.238643 May 27 15:19:44.929388 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 295/617] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:44 2022] GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:45.184931 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-67e736a7-81f9-442f-89bc-77eab5647b54 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:45.185550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-67e736a7-81f9-442f-89bc-77eab5647b54 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:45.193276 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-67e736a7-81f9-442f-89bc-77eab5647b54 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:45.193724 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-67e736a7-81f9-442f-89bc-77eab5647b54 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:45.194494 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-67e736a7-81f9-442f-89bc-77eab5647b54 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:45.195126 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-67e736a7-81f9-442f-89bc-77eab5647b54 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:45.266409 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f243d212-f49a-4a04-b262-812adddbdf61 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1807613637"}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:45.270268 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-f243d212-f49a-4a04-b262-812adddbdf61 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:45.273560 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f243d212-f49a-4a04-b262-812adddbdf61 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:45.274008 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f243d212-f49a-4a04-b262-812adddbdf61 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:45.274781 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f243d212-f49a-4a04-b262-812adddbdf61 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:45.275250 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f243d212-f49a-4a04-b262-812adddbdf61 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:45.483425 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-67e736a7-81f9-442f-89bc-77eab5647b54 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:45.495379 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-67e736a7-81f9-442f-89bc-77eab5647b54 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1735 microversion: 2.1 time: 0.314755 May 27 15:19:45.496105 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 323/618] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:45 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1735 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:45.505937 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.network.security_group_api [None req-f243d212-f49a-4a04-b262-812adddbdf61 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Removing security group 7c24bb86-dd26-42a4-9857-37932d852490 from port 499011f1-9fc8-4630-a680-e75f00a1b0e3 May 27 15:19:45.742367 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-2c66ce03-db37-4edd-9c8e-ed478ddf2ab5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Action: 'create', calling method: .version_select at 0x7f57e186ef70>, body: {"keypair": {"name": "tempest-keypair-1777242968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVzJK41j+Ha6YTO6ErPmVEpReHcS6MR0c0Rj7i4DxBX1LXTYotID94iEx26/5ZHQsf7KCGsPQSjgo18cEbcGwBOIgQeewe9Y9GWqmqWyJwRDpjeEsk1yVHmlzaEWJQ3pQ=="}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:45.758820 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-2c66ce03-db37-4edd-9c8e-ed478ddf2ab5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Getting quotas for project f20b51981801495aacd31a56e87d0e3c. Resources: {'key_pairs'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:19:45.763914 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-2c66ce03-db37-4edd-9c8e-ed478ddf2ab5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Getting quotas for user 5a990918de6d409a949616da90de6a5e and project f20b51981801495aacd31a56e87d0e3c. Resources: {'key_pairs'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:19:45.790824 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-2c66ce03-db37-4edd-9c8e-ed478ddf2ab5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.052448 May 27 15:19:45.791784 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 324/619] 10.222.0.50 () {62 vars in 1199 bytes} [Fri May 27 15:19:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 27 15:19:45.949100 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-640ee201-7008-4284-93b5-f338b849d855 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:45.950045 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-640ee201-7008-4284-93b5-f338b849d855 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:45.958679 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-640ee201-7008-4284-93b5-f338b849d855 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:45.960198 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-640ee201-7008-4284-93b5-f338b849d855 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:45.962189 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-640ee201-7008-4284-93b5-f338b849d855 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:45.963411 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-640ee201-7008-4284-93b5-f338b849d855 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:46.126020 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-f243d212-f49a-4a04-b262-812adddbdf61 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "POST /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c/action" status: 202 len: 0 microversion: 2.1 time: 0.863314 May 27 15:19:46.126632 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 296/620] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 15:19:45 2022] POST /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c/action => generated 0 bytes in 865 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:19:46.138430 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-bdf88d80-6249-4ee9-885b-2a0ef935e672 req-e642a544-8dd9-403a-81c5-e7ff7b099622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4d29ebf-5c93-4f7c-b372-121a8843600c", "tag": "499011f1-9fc8-4630-a680-e75f00a1b0e3"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:46.168215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-bdf88d80-6249-4ee9-885b-2a0ef935e672 req-e642a544-8dd9-403a-81c5-e7ff7b099622 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:46.168660 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-bdf88d80-6249-4ee9-885b-2a0ef935e672 req-e642a544-8dd9-403a-81c5-e7ff7b099622 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:46.223428 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-bdf88d80-6249-4ee9-885b-2a0ef935e672 req-e642a544-8dd9-403a-81c5-e7ff7b099622 service nova] Creating event network-changed:499011f1-9fc8-4630-a680-e75f00a1b0e3 for instance c4d29ebf-5c93-4f7c-b372-121a8843600c on hv-cinder-84254 May 27 15:19:46.239837 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-bdf88d80-6249-4ee9-885b-2a0ef935e672 req-e642a544-8dd9-403a-81c5-e7ff7b099622 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106661 May 27 15:19:46.244954 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 297/621] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:46.274348 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-640ee201-7008-4284-93b5-f338b849d855 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:46.283753 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-640ee201-7008-4284-93b5-f338b849d855 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1" status: 200 len: 1319 microversion: 2.1 time: 0.341200 May 27 15:19:46.289631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 325/622] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:45 2022] GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:46.514227 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-959f5d74-35f3-454e-afed-436717daa7bf tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:46.515343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-959f5d74-35f3-454e-afed-436717daa7bf tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:46.525690 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-959f5d74-35f3-454e-afed-436717daa7bf tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:46.526391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-959f5d74-35f3-454e-afed-436717daa7bf tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:46.527913 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-959f5d74-35f3-454e-afed-436717daa7bf tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:46.528559 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-959f5d74-35f3-454e-afed-436717daa7bf tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:46.561679 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=2 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:46.684831 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-959f5d74-35f3-454e-afed-436717daa7bf tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:46.693642 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-959f5d74-35f3-454e-afed-436717daa7bf tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1735 microversion: 2.1 time: 0.183846 May 27 15:19:46.694428 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 298/623] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:46 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:47.305809 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-39c3aa1b-6fe6-459d-a238-c2b445e1e716 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:47.306442 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-39c3aa1b-6fe6-459d-a238-c2b445e1e716 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:47.308447 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=2 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:47.315543 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-39c3aa1b-6fe6-459d-a238-c2b445e1e716 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:47.316028 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-39c3aa1b-6fe6-459d-a238-c2b445e1e716 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:47.316805 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-39c3aa1b-6fe6-459d-a238-c2b445e1e716 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:47.317242 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-39c3aa1b-6fe6-459d-a238-c2b445e1e716 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:47.450870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-39c3aa1b-6fe6-459d-a238-c2b445e1e716 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:47.458471 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-39c3aa1b-6fe6-459d-a238-c2b445e1e716 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1" status: 200 len: 1319 microversion: 2.1 time: 0.156559 May 27 15:19:47.459072 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 326/624] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:47 2022] GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:47.711283 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-52312769-cf7e-4126-8787-018ccee198e6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:47.711820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-52312769-cf7e-4126-8787-018ccee198e6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:47.718250 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-52312769-cf7e-4126-8787-018ccee198e6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:47.718696 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-52312769-cf7e-4126-8787-018ccee198e6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:47.719763 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-52312769-cf7e-4126-8787-018ccee198e6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:47.720199 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-52312769-cf7e-4126-8787-018ccee198e6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:47.862696 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-52312769-cf7e-4126-8787-018ccee198e6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:47.872395 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-52312769-cf7e-4126-8787-018ccee198e6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1735 microversion: 2.1 time: 0.165435 May 27 15:19:47.873440 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 299/625] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:47 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:47.912091 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-af09dee6-e7f7-46c3-a14c-fb55ebb07b43 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:47.913316 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-af09dee6-e7f7-46c3-a14c-fb55ebb07b43 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:47.920627 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-af09dee6-e7f7-46c3-a14c-fb55ebb07b43 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:47.921171 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-af09dee6-e7f7-46c3-a14c-fb55ebb07b43 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:47.922042 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-af09dee6-e7f7-46c3-a14c-fb55ebb07b43 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:47.922555 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-af09dee6-e7f7-46c3-a14c-fb55ebb07b43 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:47.956433 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-af09dee6-e7f7-46c3-a14c-fb55ebb07b43 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049616 May 27 15:19:47.957238 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 327/626] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 15:19:47 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:19:48.026176 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-ef9515de-de02-4dae-bf5f-db6803cfa64d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:48.026680 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-ef9515de-de02-4dae-bf5f-db6803cfa64d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:48.033743 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ef9515de-de02-4dae-bf5f-db6803cfa64d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:48.034193 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ef9515de-de02-4dae-bf5f-db6803cfa64d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:48.035229 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ef9515de-de02-4dae-bf5f-db6803cfa64d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:48.035737 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ef9515de-de02-4dae-bf5f-db6803cfa64d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:48.062455 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-ef9515de-de02-4dae-bf5f-db6803cfa64d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Going to try to terminate instance {{(pid=117743) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:19:48.082474 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-ddc5a7af-cbd4-48c6-b839-822efab060f0 req-887c756b-be90-4200-94ba-52297043a9c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1", "name": "network-vif-plugged", "status": "completed", "tag": "43619b86-23d3-4ddb-85d5-c69b05a310f0"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:48.112055 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-ddc5a7af-cbd4-48c6-b839-822efab060f0 req-887c756b-be90-4200-94ba-52297043a9c3 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:48.116813 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-ddc5a7af-cbd4-48c6-b839-822efab060f0 req-887c756b-be90-4200-94ba-52297043a9c3 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:48.134882 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-ddc5a7af-cbd4-48c6-b839-822efab060f0 req-887c756b-be90-4200-94ba-52297043a9c3 service nova] Creating event network-vif-plugged:43619b86-23d3-4ddb-85d5-c69b05a310f0 for instance 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 on hv-cinder-84254 May 27 15:19:48.140221 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-ddc5a7af-cbd4-48c6-b839-822efab060f0 req-887c756b-be90-4200-94ba-52297043a9c3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065336 May 27 15:19:48.141209 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 328/627] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:48.173488 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-ef9515de-de02-4dae-bf5f-db6803cfa64d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 204 len: 0 microversion: 2.1 time: 0.150867 May 27 15:19:48.174309 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 300/628] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:19:48 2022] DELETE /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:19:48.183275 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-fa405e34-34e2-45d5-9950-e6a250043760 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:48.184064 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-fa405e34-34e2-45d5-9950-e6a250043760 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:48.191017 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fa405e34-34e2-45d5-9950-e6a250043760 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:48.191550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fa405e34-34e2-45d5-9950-e6a250043760 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:48.192481 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fa405e34-34e2-45d5-9950-e6a250043760 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:48.192988 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fa405e34-34e2-45d5-9950-e6a250043760 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:48.352953 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-fa405e34-34e2-45d5-9950-e6a250043760 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:48.361315 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-fa405e34-34e2-45d5-9950-e6a250043760 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1674 microversion: 2.1 time: 0.182359 May 27 15:19:48.361973 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 329/629] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:48 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1674 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:48.476982 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d952bd8c-bd10-47bf-8ff2-3170330103d0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:48.477769 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-d952bd8c-bd10-47bf-8ff2-3170330103d0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:48.483972 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d952bd8c-bd10-47bf-8ff2-3170330103d0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:48.484265 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d952bd8c-bd10-47bf-8ff2-3170330103d0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:48.485226 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d952bd8c-bd10-47bf-8ff2-3170330103d0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:48.485796 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d952bd8c-bd10-47bf-8ff2-3170330103d0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:48.623776 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d952bd8c-bd10-47bf-8ff2-3170330103d0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:48.632822 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-d952bd8c-bd10-47bf-8ff2-3170330103d0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1" status: 200 len: 1319 microversion: 2.1 time: 0.160474 May 27 15:19:48.646293 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 301/630] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:48 2022] GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:48.648807 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-5f4425e7-2557-40a1-b921-e2ac20639165 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:48.649304 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-5f4425e7-2557-40a1-b921-e2ac20639165 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:48.654718 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-f568ac7c-52d1-45fa-91c2-2f884fad08a1 req-2bedcf11-47ad-42bf-a5d2-7347cff6f891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4d29ebf-5c93-4f7c-b372-121a8843600c", "tag": "499011f1-9fc8-4630-a680-e75f00a1b0e3"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:48.656613 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5f4425e7-2557-40a1-b921-e2ac20639165 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:48.657249 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5f4425e7-2557-40a1-b921-e2ac20639165 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:48.658233 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5f4425e7-2557-40a1-b921-e2ac20639165 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:48.659178 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5f4425e7-2557-40a1-b921-e2ac20639165 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:48.667659 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-f568ac7c-52d1-45fa-91c2-2f884fad08a1 req-2bedcf11-47ad-42bf-a5d2-7347cff6f891 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:48.669022 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-f568ac7c-52d1-45fa-91c2-2f884fad08a1 req-2bedcf11-47ad-42bf-a5d2-7347cff6f891 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:48.683482 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-f568ac7c-52d1-45fa-91c2-2f884fad08a1 req-2bedcf11-47ad-42bf-a5d2-7347cff6f891 service nova] Creating event network-changed:499011f1-9fc8-4630-a680-e75f00a1b0e3 for instance c4d29ebf-5c93-4f7c-b372-121a8843600c on hv-cinder-84254 May 27 15:19:48.690276 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-f568ac7c-52d1-45fa-91c2-2f884fad08a1 req-2bedcf11-47ad-42bf-a5d2-7347cff6f891 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038686 May 27 15:19:48.691519 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 302/631] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:48.758174 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.objects.instance [None req-5f4425e7-2557-40a1-b921-e2ac20639165 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lazy-loading 'services' on Instance uuid c4d29ebf-5c93-4f7c-b372-121a8843600c {{(pid=117742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:19:48.841428 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-5f4425e7-2557-40a1-b921-e2ac20639165 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c/os-volume_attachments/bf97fb43-3c89-4fc0-a71c-cc6bcf0a8177" status: 202 len: 0 microversion: 2.1 time: 0.196877 May 27 15:19:48.842044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 330/632] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 15:19:48 2022] DELETE /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c/os-volume_attachments/bf97fb43-3c89-4fc0-a71c-cc6bcf0a8177 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:19:48.851036 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-010af6a9-ec68-492a-8d20-d455b23fd8e0 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:48.852048 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-010af6a9-ec68-492a-8d20-d455b23fd8e0 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:48.858730 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-010af6a9-ec68-492a-8d20-d455b23fd8e0 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:48.859226 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-010af6a9-ec68-492a-8d20-d455b23fd8e0 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:48.860002 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-010af6a9-ec68-492a-8d20-d455b23fd8e0 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:48.860438 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-010af6a9-ec68-492a-8d20-d455b23fd8e0 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:48.888702 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ec4f1958-e9bf-453f-8968-1442c5dbfeb2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1695561109", "imageRef": "a9407644-1f68-43e6-beb1-ce2085766180", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "275a0f8b-f6c2-4374-b604-c47608ee55ce"}], "security_groups": [{"name": "tempest-securitygroup--1520007488"}], "key_name": "tempest-keypair-1777242968", "user_data": "}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:48.899936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-010af6a9-ec68-492a-8d20-d455b23fd8e0 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053108 May 27 15:19:48.900809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 303/633] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 15:19:48 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:19:48.905148 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d751c76b-08f1-4fae-8b49-443e3f1df0ad tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:48.905840 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-d751c76b-08f1-4fae-8b49-443e3f1df0ad tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:48.913117 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d751c76b-08f1-4fae-8b49-443e3f1df0ad tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:48.913635 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d751c76b-08f1-4fae-8b49-443e3f1df0ad tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:48.914340 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d751c76b-08f1-4fae-8b49-443e3f1df0ad tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:48.914776 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d751c76b-08f1-4fae-8b49-443e3f1df0ad tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:49.036273 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.network.neutron [None req-ec4f1958-e9bf-453f-8968-1442c5dbfeb2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] validate_networks() for [('275a0f8b-f6c2-4374-b604-c47608ee55ce', None, None, None, None, None)] {{(pid=117742) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:19:49.148494 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d751c76b-08f1-4fae-8b49-443e3f1df0ad tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:49.161568 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-d751c76b-08f1-4fae-8b49-443e3f1df0ad tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1735 microversion: 2.1 time: 0.259088 May 27 15:19:49.165085 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 304/634] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:48 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1735 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:49.252531 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:49.381729 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-427e325f-ec1e-42bd-b457-f40fc35b7f0b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:49.381729 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-427e325f-ec1e-42bd-b457-f40fc35b7f0b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:49.388671 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-427e325f-ec1e-42bd-b457-f40fc35b7f0b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:49.389265 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-427e325f-ec1e-42bd-b457-f40fc35b7f0b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:49.390164 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-427e325f-ec1e-42bd-b457-f40fc35b7f0b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:49.390695 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-427e325f-ec1e-42bd-b457-f40fc35b7f0b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:49.410358 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:49.462239 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-ec4f1958-e9bf-453f-8968-1442c5dbfeb2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Flavor limits 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:19:49.462724 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-ec4f1958-e9bf-453f-8968-1442c5dbfeb2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Image limits 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:19:49.463181 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-ec4f1958-e9bf-453f-8968-1442c5dbfeb2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Flavor pref 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:19:49.463591 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-ec4f1958-e9bf-453f-8968-1442c5dbfeb2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Image pref 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:19:49.464002 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-ec4f1958-e9bf-453f-8968-1442c5dbfeb2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:19:49.474274 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ec4f1958-e9bf-453f-8968-1442c5dbfeb2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:49.474721 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ec4f1958-e9bf-453f-8968-1442c5dbfeb2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:49.475568 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ec4f1958-e9bf-453f-8968-1442c5dbfeb2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:49.475996 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ec4f1958-e9bf-453f-8968-1442c5dbfeb2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:49.495172 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-ec4f1958-e9bf-453f-8968-1442c5dbfeb2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Getting quotas for project f20b51981801495aacd31a56e87d0e3c. Resources: {'cores', 'ram', 'instances'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:19:49.499572 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-ec4f1958-e9bf-453f-8968-1442c5dbfeb2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Getting quotas for user 5a990918de6d409a949616da90de6a5e and project f20b51981801495aacd31a56e87d0e3c. Resources: {'cores', 'ram', 'instances'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:19:49.514636 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ec4f1958-e9bf-453f-8968-1442c5dbfeb2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Going to run 1 instances... {{(pid=117742) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:19:49.517102 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ec4f1958-e9bf-453f-8968-1442c5dbfeb2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9407644-1f68-43e6-beb1-ce2085766180',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117742) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:19:49.566185 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-427e325f-ec1e-42bd-b457-f40fc35b7f0b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:49.573828 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ec4f1958-e9bf-453f-8968-1442c5dbfeb2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.689209 May 27 15:19:49.579886 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-427e325f-ec1e-42bd-b457-f40fc35b7f0b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1674 microversion: 2.1 time: 0.198946 May 27 15:19:49.579886 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 305/635] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:49 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1674 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:49.580469 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 331/636] 10.222.0.50 () {62 vars in 1187 bytes} [Fri May 27 15:19:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 15:19:49.588308 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-1bf815c7-6623-4bc6-98c3-dcd98f2aba04 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:49.588481 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-1bf815c7-6623-4bc6-98c3-dcd98f2aba04 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:49.646926 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-1bf815c7-6623-4bc6-98c3-dcd98f2aba04 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:49.650184 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-2a7bd6ef-9584-4d08-bd09-bc3ed1163d64 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:49.651038 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-2a7bd6ef-9584-4d08-bd09-bc3ed1163d64 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:49.656245 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-1bf815c7-6623-4bc6-98c3-dcd98f2aba04 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:49.658794 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-1bf815c7-6623-4bc6-98c3-dcd98f2aba04 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:49.659097 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2a7bd6ef-9584-4d08-bd09-bc3ed1163d64 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:49.659557 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2a7bd6ef-9584-4d08-bd09-bc3ed1163d64 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:49.660272 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-1bf815c7-6623-4bc6-98c3-dcd98f2aba04 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1282 microversion: 2.20 time: 0.076872 May 27 15:19:49.660381 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2a7bd6ef-9584-4d08-bd09-bc3ed1163d64 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:49.660767 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2a7bd6ef-9584-4d08-bd09-bc3ed1163d64 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:49.671464 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 306/637] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:19:49 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1282 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:49.812818 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-2a7bd6ef-9584-4d08-bd09-bc3ed1163d64 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:49.820898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-2a7bd6ef-9584-4d08-bd09-bc3ed1163d64 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1" status: 200 len: 1319 microversion: 2.1 time: 0.174730 May 27 15:19:49.822528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 332/638] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:49 2022] GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:49.912523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-885975df-4fca-4e2f-811b-8f39af4a580d tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:49.913652 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-885975df-4fca-4e2f-811b-8f39af4a580d tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:49.921804 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-885975df-4fca-4e2f-811b-8f39af4a580d tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:49.922274 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-885975df-4fca-4e2f-811b-8f39af4a580d tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:49.923075 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-885975df-4fca-4e2f-811b-8f39af4a580d tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:49.923523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-885975df-4fca-4e2f-811b-8f39af4a580d tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:49.956781 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-885975df-4fca-4e2f-811b-8f39af4a580d tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048801 May 27 15:19:49.957365 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 307/639] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 15:19:49 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:50.181351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-64ad9964-91c5-4849-bd44-763a0c93a5db tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:50.181963 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-64ad9964-91c5-4849-bd44-763a0c93a5db tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:50.188688 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-64ad9964-91c5-4849-bd44-763a0c93a5db tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:50.189174 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-64ad9964-91c5-4849-bd44-763a0c93a5db tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:50.189950 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-64ad9964-91c5-4849-bd44-763a0c93a5db tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:50.190471 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-64ad9964-91c5-4849-bd44-763a0c93a5db tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:50.324845 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-64ad9964-91c5-4849-bd44-763a0c93a5db tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:50.333382 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-64ad9964-91c5-4849-bd44-763a0c93a5db tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1735 microversion: 2.1 time: 0.155867 May 27 15:19:50.334176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 333/640] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:50 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:50.592780 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a2ab087d-0d84-4fac-8d0f-20fb0aeb0490 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:50.593781 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a2ab087d-0d84-4fac-8d0f-20fb0aeb0490 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:50.602028 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a2ab087d-0d84-4fac-8d0f-20fb0aeb0490 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:50.602540 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a2ab087d-0d84-4fac-8d0f-20fb0aeb0490 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:50.603486 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a2ab087d-0d84-4fac-8d0f-20fb0aeb0490 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:50.604104 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a2ab087d-0d84-4fac-8d0f-20fb0aeb0490 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:50.678925 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-573d38ef-9900-418f-9b56-55ea8d34e709 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:50.679575 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-573d38ef-9900-418f-9b56-55ea8d34e709 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:50.686096 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-573d38ef-9900-418f-9b56-55ea8d34e709 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:50.686544 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-573d38ef-9900-418f-9b56-55ea8d34e709 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:50.687376 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-573d38ef-9900-418f-9b56-55ea8d34e709 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:50.687833 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-573d38ef-9900-418f-9b56-55ea8d34e709 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:50.756652 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-573d38ef-9900-418f-9b56-55ea8d34e709 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:50.764855 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-573d38ef-9900-418f-9b56-55ea8d34e709 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:50.766481 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-573d38ef-9900-418f-9b56-55ea8d34e709 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:50.767831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-573d38ef-9900-418f-9b56-55ea8d34e709 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1278 microversion: 2.20 time: 0.092987 May 27 15:19:50.768508 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 334/641] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:19:50 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1278 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:50.773126 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a2ab087d-0d84-4fac-8d0f-20fb0aeb0490 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:50.780975 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a2ab087d-0d84-4fac-8d0f-20fb0aeb0490 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1674 microversion: 2.1 time: 0.192089 May 27 15:19:50.781712 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 308/642] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:50 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1674 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:50.839076 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ee63ac07-53ff-4cba-b428-fd2a7c9dfb79 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:50.839690 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ee63ac07-53ff-4cba-b428-fd2a7c9dfb79 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:50.846730 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ee63ac07-53ff-4cba-b428-fd2a7c9dfb79 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:50.847142 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ee63ac07-53ff-4cba-b428-fd2a7c9dfb79 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:50.847915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ee63ac07-53ff-4cba-b428-fd2a7c9dfb79 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:50.848392 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ee63ac07-53ff-4cba-b428-fd2a7c9dfb79 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:50.968814 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-88c0cbfb-c75e-422d-b649-53c6513fa0a8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:50.970391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-88c0cbfb-c75e-422d-b649-53c6513fa0a8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:50.977224 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-88c0cbfb-c75e-422d-b649-53c6513fa0a8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:50.977669 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-88c0cbfb-c75e-422d-b649-53c6513fa0a8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:50.978432 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-88c0cbfb-c75e-422d-b649-53c6513fa0a8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:50.978874 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-88c0cbfb-c75e-422d-b649-53c6513fa0a8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:50.985646 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-ee63ac07-53ff-4cba-b428-fd2a7c9dfb79 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:50.993731 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ee63ac07-53ff-4cba-b428-fd2a7c9dfb79 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1" status: 200 len: 1319 microversion: 2.1 time: 0.158566 May 27 15:19:50.994306 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 335/643] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:50 2022] GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:51.008995 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-88c0cbfb-c75e-422d-b649-53c6513fa0a8 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044388 May 27 15:19:51.009566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 309/644] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 15:19:50 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:19:51.352455 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f51b5b1e-5405-4a82-8591-2832f1fb43b6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:51.353165 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f51b5b1e-5405-4a82-8591-2832f1fb43b6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:51.359996 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f51b5b1e-5405-4a82-8591-2832f1fb43b6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:51.360711 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f51b5b1e-5405-4a82-8591-2832f1fb43b6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:51.362150 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f51b5b1e-5405-4a82-8591-2832f1fb43b6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:51.362690 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f51b5b1e-5405-4a82-8591-2832f1fb43b6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:51.624779 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f51b5b1e-5405-4a82-8591-2832f1fb43b6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:51.628431 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:51.634364 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f51b5b1e-5405-4a82-8591-2832f1fb43b6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1735 microversion: 2.1 time: 0.285853 May 27 15:19:51.635073 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 336/645] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:51 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1735 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:51.787014 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b531abc0-2bcd-4113-9c8b-2036b7e12911 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:51.787849 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b531abc0-2bcd-4113-9c8b-2036b7e12911 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:51.789867 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:51.796094 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b531abc0-2bcd-4113-9c8b-2036b7e12911 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:51.796638 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b531abc0-2bcd-4113-9c8b-2036b7e12911 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:51.797540 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b531abc0-2bcd-4113-9c8b-2036b7e12911 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:51.798112 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b531abc0-2bcd-4113-9c8b-2036b7e12911 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:51.800932 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-d97f627e-d850-4068-ae13-efa75ed139d0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:51.801781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-d97f627e-d850-4068-ae13-efa75ed139d0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:51.809342 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d97f627e-d850-4068-ae13-efa75ed139d0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:51.809895 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d97f627e-d850-4068-ae13-efa75ed139d0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:51.810802 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d97f627e-d850-4068-ae13-efa75ed139d0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:51.811344 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d97f627e-d850-4068-ae13-efa75ed139d0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:51.965588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b531abc0-2bcd-4113-9c8b-2036b7e12911 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:51.976039 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b531abc0-2bcd-4113-9c8b-2036b7e12911 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:51.977563 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b531abc0-2bcd-4113-9c8b-2036b7e12911 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:51.978684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b531abc0-2bcd-4113-9c8b-2036b7e12911 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1334 microversion: 2.20 time: 0.195744 May 27 15:19:51.990107 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 310/646] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:19:51 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1334 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:52.012152 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f2e4bfbd-03d9-44b5-bb7c-390fe9b6955e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:52.012883 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-f2e4bfbd-03d9-44b5-bb7c-390fe9b6955e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:52.027930 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f2e4bfbd-03d9-44b5-bb7c-390fe9b6955e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:52.028479 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f2e4bfbd-03d9-44b5-bb7c-390fe9b6955e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:52.029466 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f2e4bfbd-03d9-44b5-bb7c-390fe9b6955e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:52.029964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f2e4bfbd-03d9-44b5-bb7c-390fe9b6955e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:52.163920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-d97f627e-d850-4068-ae13-efa75ed139d0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:52.171610 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-d97f627e-d850-4068-ae13-efa75ed139d0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1674 microversion: 2.1 time: 0.376543 May 27 15:19:52.172243 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 337/647] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:51 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1674 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:52.181154 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-255a1550-6611-4144-8b73-ff60051e252b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:52.181154 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-255a1550-6611-4144-8b73-ff60051e252b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:52.187262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-255a1550-6611-4144-8b73-ff60051e252b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:52.187739 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-255a1550-6611-4144-8b73-ff60051e252b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:52.188539 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-255a1550-6611-4144-8b73-ff60051e252b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:52.188976 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-255a1550-6611-4144-8b73-ff60051e252b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:52.218189 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-255a1550-6611-4144-8b73-ff60051e252b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044822 May 27 15:19:52.219172 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 338/648] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 15:19:52 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:52.244929 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f2e4bfbd-03d9-44b5-bb7c-390fe9b6955e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:52.252409 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-f2e4bfbd-03d9-44b5-bb7c-390fe9b6955e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1" status: 200 len: 1319 microversion: 2.1 time: 0.244355 May 27 15:19:52.252980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 311/649] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:52 2022] GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:52.653918 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-3032930e-204c-4cfb-8d33-42a5f2906391 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:52.654530 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-3032930e-204c-4cfb-8d33-42a5f2906391 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:52.665753 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3032930e-204c-4cfb-8d33-42a5f2906391 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:52.666193 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3032930e-204c-4cfb-8d33-42a5f2906391 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:52.666992 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3032930e-204c-4cfb-8d33-42a5f2906391 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:52.668178 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3032930e-204c-4cfb-8d33-42a5f2906391 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:52.668335 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-914f50a3-d252-41e8-8374-cb57339c2e6b req-de9f1c62-c91f-4c76-9e43-d5cdbe7fa03d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f61fd2c2-bca4-412d-93c3-5a3aee3a3b27", "name": "network-vif-deleted", "tag": "8aadec0a-6b37-4955-aa4d-147789e9560f"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:52.703941 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-914f50a3-d252-41e8-8374-cb57339c2e6b req-de9f1c62-c91f-4c76-9e43-d5cdbe7fa03d service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:52.704474 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-914f50a3-d252-41e8-8374-cb57339c2e6b req-de9f1c62-c91f-4c76-9e43-d5cdbe7fa03d service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:52.733208 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-914f50a3-d252-41e8-8374-cb57339c2e6b req-de9f1c62-c91f-4c76-9e43-d5cdbe7fa03d service nova] Creating event network-vif-deleted:8aadec0a-6b37-4955-aa4d-147789e9560f for instance f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 on hv-cinder-84254 May 27 15:19:52.758244 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-914f50a3-d252-41e8-8374-cb57339c2e6b req-de9f1c62-c91f-4c76-9e43-d5cdbe7fa03d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088845 May 27 15:19:52.759318 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 312/650] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:19:52.853677 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-3032930e-204c-4cfb-8d33-42a5f2906391 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:52.863679 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-3032930e-204c-4cfb-8d33-42a5f2906391 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1735 microversion: 2.1 time: 0.213640 May 27 15:19:52.864811 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 339/651] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:52 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:52.998771 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a1259fd4-bf01-4bd6-8845-c59109c545e2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:52.999630 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a1259fd4-bf01-4bd6-8845-c59109c545e2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:53.008298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a1259fd4-bf01-4bd6-8845-c59109c545e2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:53.009021 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a1259fd4-bf01-4bd6-8845-c59109c545e2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:53.010221 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a1259fd4-bf01-4bd6-8845-c59109c545e2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:53.011103 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a1259fd4-bf01-4bd6-8845-c59109c545e2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:53.078666 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a1259fd4-bf01-4bd6-8845-c59109c545e2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:53.087340 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a1259fd4-bf01-4bd6-8845-c59109c545e2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:53.089091 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a1259fd4-bf01-4bd6-8845-c59109c545e2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:53.090264 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a1259fd4-bf01-4bd6-8845-c59109c545e2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1340 microversion: 2.20 time: 0.096355 May 27 15:19:53.090908 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 313/652] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:19:52 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1340 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:19:53.188964 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-48ed72f3-6db3-4ca1-8961-2fc613d6070b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:53.190299 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-48ed72f3-6db3-4ca1-8961-2fc613d6070b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:53.196325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-48ed72f3-6db3-4ca1-8961-2fc613d6070b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:53.196775 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-48ed72f3-6db3-4ca1-8961-2fc613d6070b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:53.197581 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-48ed72f3-6db3-4ca1-8961-2fc613d6070b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:53.198004 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-48ed72f3-6db3-4ca1-8961-2fc613d6070b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:53.230707 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-7bd98cfc-6012-4495-b985-6de1f12487cf tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:53.231753 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-7bd98cfc-6012-4495-b985-6de1f12487cf tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:53.238723 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-7bd98cfc-6012-4495-b985-6de1f12487cf tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:53.239372 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-7bd98cfc-6012-4495-b985-6de1f12487cf tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:53.240205 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-7bd98cfc-6012-4495-b985-6de1f12487cf tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:53.241620 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-7bd98cfc-6012-4495-b985-6de1f12487cf tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:53.265291 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-48ed72f3-6db3-4ca1-8961-2fc613d6070b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:53.274326 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-48ed72f3-6db3-4ca1-8961-2fc613d6070b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1323 microversion: 2.1 time: 0.089173 May 27 15:19:53.274578 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-7bd98cfc-6012-4495-b985-6de1f12487cf tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047421 May 27 15:19:53.275072 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 314/653] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 15:19:53 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 15:19:53.280242 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9ef860cd-07eb-40ba-9e98-d65736243d9e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:53.280849 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9ef860cd-07eb-40ba-9e98-d65736243d9e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:53.284456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 340/654] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:53 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1323 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:53.287339 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9ef860cd-07eb-40ba-9e98-d65736243d9e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:53.287788 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9ef860cd-07eb-40ba-9e98-d65736243d9e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:53.288559 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9ef860cd-07eb-40ba-9e98-d65736243d9e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:53.288996 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9ef860cd-07eb-40ba-9e98-d65736243d9e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:53.290324 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-4335f268-df3e-47aa-be20-3f206e6ae195 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:53.290909 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-4335f268-df3e-47aa-be20-3f206e6ae195 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:53.299895 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4335f268-df3e-47aa-be20-3f206e6ae195 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:53.300499 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4335f268-df3e-47aa-be20-3f206e6ae195 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:53.301435 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4335f268-df3e-47aa-be20-3f206e6ae195 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:53.302003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4335f268-df3e-47aa-be20-3f206e6ae195 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:53.390472 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-4335f268-df3e-47aa-be20-3f206e6ae195 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] HTTP exception thrown: Instance c4d29ebf-5c93-4f7c-b372-121a8843600c is not attached to volume bf97fb43-3c89-4fc0-a71c-cc6bcf0a8177 May 27 15:19:53.411524 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-4335f268-df3e-47aa-be20-3f206e6ae195 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Request method failure captured: May 27 15:19:53.411524 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: DELETE /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c/os-volume_attachments/bf97fb43-3c89-4fc0-a71c-cc6bcf0a8177 HTTP/1.1 May 27 15:19:53.411524 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:19:53.411524 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:19:53.411524 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:19:53.411524 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:19:53.411524 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:19:53.411524 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:19:53.411524 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:19:53.411524 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:19:53.411524 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOsqeNnkoVBiAdkJHmdMDXCJgCNP4WKoWr-AxgQmUyS7Q6km3jDRWkUDCFYji1DBgXfxxcF4PV4xtQMaP6FRsrjOWAwo7hZnEdif8_ba0j43HNmkdq8nSzsuRjaUZ_KYhUeNxhL95Cx7WIyc74Io84Ceinj5P4g623ANSw2XY0Nxnsg May 27 15:19:53.411524 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:19:53.411524 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:19:53.411524 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:19:53.411524 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:19:53.411524 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:19:53.411524 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:19:53.411524 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: 7facd29ad0d746099537a1b1345c2c90 May 27 15:19:53.411524 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-TestMinimumBasicScenario-834081231 May 27 15:19:53.411524 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:19:53.411524 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:19:53.413036 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7facd29ad0d746099537a1b1345c2c90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7facd29ad0d746099537a1b1345c2c90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7facd29ad0d746099537a1b1345c2c90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7facd29ad0d746099537a1b1345c2c90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:19:53.413036 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-TestMinimumBasicScenario-834081231 May 27 15:19:53.413036 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: 7facd29ad0d746099537a1b1345c2c90 May 27 15:19:53.413036 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-TestMinimumBasicScenario-834081231 May 27 15:19:53.413036 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-TestMinimumBasicScenario-834081231-project May 27 15:19:53.413036 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:19:53.413036 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:19:53.413036 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 50ca9d699b004df4becfe3241802fb17 May 27 15:19:53.413036 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-TestMinimumBasicScenario-834081231-project May 27 15:19:53.413036 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:19:53.413036 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance c4d29ebf-5c93-4f7c-b372-121a8843600c is not attached to volume bf97fb43-3c89-4fc0-a71c-cc6bcf0a8177 May 27 15:19:53.413847 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'server_id': 'c4d29ebf-5c93-4f7c-b372-121a8843600c', 'id': 'bf97fb43-3c89-4fc0-a71c-cc6bcf0a8177'} May 27 15:19:53.413847 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:19:53.413847 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:53.413847 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 27 15:19:53.413847 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 27 15:19:53.413847 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 15:19:53.413847 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 15:19:53.413847 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 27 15:19:53.413847 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 27 15:19:53.413847 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bf97fb43-3c89-4fc0-a71c-cc6bcf0a8177. May 27 15:19:53.413847 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:19:53.413847 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:53.413847 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:19:53.413847 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:53.413847 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:53.413847 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:53.413847 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:19:53.413847 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:19:53.413847 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:19:53.415204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:19:53.415204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 27 15:19:53.415204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 27 15:19:53.415204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4d29ebf-5c93-4f7c-b372-121a8843600c is not attached to volume bf97fb43-3c89-4fc0-a71c-cc6bcf0a8177 May 27 15:19:53.415204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:19:53.415204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:53.415204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:19:53.415204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:53.415204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:53.415204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:53.415204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:19:53.415204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:19:53.415204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d29ebf-5c93-4f7c-b372-121a8843600c is not attached to volume bf97fb43-3c89-4fc0-a71c-cc6bcf0a8177 May 27 15:19:53.415204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:19:53.415204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-4335f268-df3e-47aa-be20-3f206e6ae195 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Returning 404 to user: Instance c4d29ebf-5c93-4f7c-b372-121a8843600c is not attached to volume bf97fb43-3c89-4fc0-a71c-cc6bcf0a8177 {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:19:53.416262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-4335f268-df3e-47aa-be20-3f206e6ae195 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c/os-volume_attachments/bf97fb43-3c89-4fc0-a71c-cc6bcf0a8177" status: 404 len: 154 microversion: 2.1 time: 0.127623 May 27 15:19:53.416262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 341/655] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 15:19:53 2022] DELETE /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c/os-volume_attachments/bf97fb43-3c89-4fc0-a71c-cc6bcf0a8177 => generated 154 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:19:53.452743 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9ef860cd-07eb-40ba-9e98-d65736243d9e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:53.461399 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9ef860cd-07eb-40ba-9e98-d65736243d9e tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1" status: 200 len: 1507 microversion: 2.1 time: 0.185134 May 27 15:19:53.468137 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 315/656] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:53 2022] GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:53.481713 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b118b454-73c3-4725-a7f4-c1642db2cd8c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "946af515-90b3-465b-a1e1-4c712a18c03d", "device": "/dev/sdb"}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:53.483155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b118b454-73c3-4725-a7f4-c1642db2cd8c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:53.497661 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b118b454-73c3-4725-a7f4-c1642db2cd8c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:53.498120 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b118b454-73c3-4725-a7f4-c1642db2cd8c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:53.499179 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b118b454-73c3-4725-a7f4-c1642db2cd8c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:53.499786 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b118b454-73c3-4725-a7f4-c1642db2cd8c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:53.888681 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-c9e35518-67d6-4d62-8c59-eaec9873dd89 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:53.889394 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-c9e35518-67d6-4d62-8c59-eaec9873dd89 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:53.897050 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c9e35518-67d6-4d62-8c59-eaec9873dd89 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:53.897528 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c9e35518-67d6-4d62-8c59-eaec9873dd89 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:53.898325 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c9e35518-67d6-4d62-8c59-eaec9873dd89 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:53.898767 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c9e35518-67d6-4d62-8c59-eaec9873dd89 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:54.044304 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-c9e35518-67d6-4d62-8c59-eaec9873dd89 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:54.052864 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-c9e35518-67d6-4d62-8c59-eaec9873dd89 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1735 microversion: 2.1 time: 0.175736 May 27 15:19:54.053442 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 316/657] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:53 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:19:54.109515 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-c3ded696-bc19-4ea8-89ec-50b4d03ead7d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:54.110417 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-c3ded696-bc19-4ea8-89ec-50b4d03ead7d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:54.117418 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c3ded696-bc19-4ea8-89ec-50b4d03ead7d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:54.118042 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c3ded696-bc19-4ea8-89ec-50b4d03ead7d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:54.119160 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c3ded696-bc19-4ea8-89ec-50b4d03ead7d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:54.119403 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c3ded696-bc19-4ea8-89ec-50b4d03ead7d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:54.192749 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-c3ded696-bc19-4ea8-89ec-50b4d03ead7d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:54.204151 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-c3ded696-bc19-4ea8-89ec-50b4d03ead7d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:54.206466 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-c3ded696-bc19-4ea8-89ec-50b4d03ead7d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:54.207840 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-c3ded696-bc19-4ea8-89ec-50b4d03ead7d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1340 microversion: 2.20 time: 0.103284 May 27 15:19:54.208900 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 317/658] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:19:54 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1340 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:19:54.296045 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b348af79-4cb2-4627-bb95-94da48adacb6 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:54.298128 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b348af79-4cb2-4627-bb95-94da48adacb6 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:54.307039 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b348af79-4cb2-4627-bb95-94da48adacb6 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:54.308594 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b348af79-4cb2-4627-bb95-94da48adacb6 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:54.309923 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b348af79-4cb2-4627-bb95-94da48adacb6 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:54.310582 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b348af79-4cb2-4627-bb95-94da48adacb6 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:54.321023 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b118b454-73c3-4725-a7f4-c1642db2cd8c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "POST /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.844758 May 27 15:19:54.322074 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 342/659] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 15:19:53 2022] POST /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1/os-volume_attachments => generated 194 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:54.358698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b348af79-4cb2-4627-bb95-94da48adacb6 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:54.359420 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b348af79-4cb2-4627-bb95-94da48adacb6 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:54.360040 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.objects.instance [None req-b348af79-4cb2-4627-bb95-94da48adacb6 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lazy-loading 'fault' on Instance uuid f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 {{(pid=117743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:19:54.410997 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b348af79-4cb2-4627-bb95-94da48adacb6 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:54.418564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b348af79-4cb2-4627-bb95-94da48adacb6 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 200 len: 1328 microversion: 2.1 time: 0.129541 May 27 15:19:54.432116 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 318/660] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:54 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 1328 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:54.604320 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-91246e62-f6c4-461c-994e-82394e375f74 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:54.605137 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-91246e62-f6c4-461c-994e-82394e375f74 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:54.613807 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-91246e62-f6c4-461c-994e-82394e375f74 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:54.614223 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-91246e62-f6c4-461c-994e-82394e375f74 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:54.615030 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-91246e62-f6c4-461c-994e-82394e375f74 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:54.615506 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-91246e62-f6c4-461c-994e-82394e375f74 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:54.644348 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-91246e62-f6c4-461c-994e-82394e375f74 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Going to try to terminate instance {{(pid=117742) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:19:54.725828 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-91246e62-f6c4-461c-994e-82394e375f74 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 204 len: 0 microversion: 2.1 time: 0.125236 May 27 15:19:54.729526 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 343/661] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:19:54 2022] DELETE /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:19:54.735136 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-3f248ef1-49a0-43f1-b429-15694a655c0c tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:54.736839 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-3f248ef1-49a0-43f1-b429-15694a655c0c tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:54.743275 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3f248ef1-49a0-43f1-b429-15694a655c0c tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:54.743991 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3f248ef1-49a0-43f1-b429-15694a655c0c tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:54.744772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3f248ef1-49a0-43f1-b429-15694a655c0c tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:54.745220 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3f248ef1-49a0-43f1-b429-15694a655c0c tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:54.883709 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-3f248ef1-49a0-43f1-b429-15694a655c0c tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:54.893458 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-3f248ef1-49a0-43f1-b429-15694a655c0c tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1555 microversion: 2.1 time: 0.162344 May 27 15:19:54.894118 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 319/662] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:54 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:55.070623 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-c7399fbb-f262-4544-9a74-92fee9d1572b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:55.072053 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-c7399fbb-f262-4544-9a74-92fee9d1572b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:55.078631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c7399fbb-f262-4544-9a74-92fee9d1572b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:55.079183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c7399fbb-f262-4544-9a74-92fee9d1572b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:55.080465 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c7399fbb-f262-4544-9a74-92fee9d1572b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:55.080967 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c7399fbb-f262-4544-9a74-92fee9d1572b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:55.231408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-c55cfb0c-03b9-4f7f-aa72-f5e93a30ce18 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:55.232952 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-c55cfb0c-03b9-4f7f-aa72-f5e93a30ce18 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:55.242310 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c55cfb0c-03b9-4f7f-aa72-f5e93a30ce18 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:55.243110 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c55cfb0c-03b9-4f7f-aa72-f5e93a30ce18 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:55.244076 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c55cfb0c-03b9-4f7f-aa72-f5e93a30ce18 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:55.244888 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c55cfb0c-03b9-4f7f-aa72-f5e93a30ce18 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:55.265984 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-c7399fbb-f262-4544-9a74-92fee9d1572b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:55.280168 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-c7399fbb-f262-4544-9a74-92fee9d1572b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1735 microversion: 2.1 time: 0.213636 May 27 15:19:55.281085 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 344/663] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:55 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:55.361163 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-ec3657f9-f0db-4014-8117-53a282b2ca53 req-bd7fb86b-5ebf-4698-8244-a8009d6b29d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1c52039-f595-4f22-9df9-ea3a999f55fe", "tag": "00ae88d7-8fbc-40d5-aefb-819837b95c30"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:55.376762 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-ec3657f9-f0db-4014-8117-53a282b2ca53 req-bd7fb86b-5ebf-4698-8244-a8009d6b29d1 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:55.377273 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-ec3657f9-f0db-4014-8117-53a282b2ca53 req-bd7fb86b-5ebf-4698-8244-a8009d6b29d1 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:55.391255 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-ec3657f9-f0db-4014-8117-53a282b2ca53 req-bd7fb86b-5ebf-4698-8244-a8009d6b29d1 service nova] Creating event network-changed:00ae88d7-8fbc-40d5-aefb-819837b95c30 for instance f1c52039-f595-4f22-9df9-ea3a999f55fe on hv-cinder-84254 May 27 15:19:55.398337 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-ec3657f9-f0db-4014-8117-53a282b2ca53 req-bd7fb86b-5ebf-4698-8244-a8009d6b29d1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041236 May 27 15:19:55.399309 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 345/664] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:19:55.410834 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-c55cfb0c-03b9-4f7f-aa72-f5e93a30ce18 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:55.440066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8cda640e-1cce-4e29-8045-1a6de2de02a3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:55.440774 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-8cda640e-1cce-4e29-8045-1a6de2de02a3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:55.443330 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-c55cfb0c-03b9-4f7f-aa72-f5e93a30ce18 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:55.444962 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-c55cfb0c-03b9-4f7f-aa72-f5e93a30ce18 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:55.446114 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-c55cfb0c-03b9-4f7f-aa72-f5e93a30ce18 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1408 microversion: 2.20 time: 0.223271 May 27 15:19:55.446894 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 320/665] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:19:55 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:55.451739 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8cda640e-1cce-4e29-8045-1a6de2de02a3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:55.453191 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8cda640e-1cce-4e29-8045-1a6de2de02a3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:55.454129 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8cda640e-1cce-4e29-8045-1a6de2de02a3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:55.455249 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8cda640e-1cce-4e29-8045-1a6de2de02a3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:55.476729 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-8cda640e-1cce-4e29-8045-1a6de2de02a3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] HTTP exception thrown: Instance f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 could not be found. May 27 15:19:55.478537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8cda640e-1cce-4e29-8045-1a6de2de02a3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Request method failure captured: May 27 15:19:55.478537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 HTTP/1.1 May 27 15:19:55.478537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:19:55.478537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:19:55.478537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:19:55.478537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:19:55.478537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:19:55.478537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:19:55.478537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:19:55.478537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:19:55.478537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOrwVPMKqGva0TqpnvQqy9GorwPqfdKa_jfChiWsOWfuH4HZt9x_1f4GiPTECprJW-Jg2kdbZGUWG7dV_-0FnTd9CT-7i9Q3IDc58WmKKPlyVUKIAVD90kCkm4vUmKhTkH2z1K5cbI_o-ZQqGAYbrkKQR9TBlFa1hb370GJqQHyoR-M May 27 15:19:55.478537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:19:55.478537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:19:55.478537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:19:55.478537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:19:55.478537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:19:55.478537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:19:55.478537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: 0bf15a964f8048b48bc794051cd56add May 27 15:19:55.478537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-AttachVolumeTestJSON-17996642 May 27 15:19:55.478537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:19:55.478537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:19:55.480419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0bf15a964f8048b48bc794051cd56add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0bf15a964f8048b48bc794051cd56add"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0bf15a964f8048b48bc794051cd56add"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0bf15a964f8048b48bc794051cd56add"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:19:55.480419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-AttachVolumeTestJSON-17996642 May 27 15:19:55.480419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: 0bf15a964f8048b48bc794051cd56add May 27 15:19:55.480419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-AttachVolumeTestJSON-17996642 May 27 15:19:55.480419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-AttachVolumeTestJSON-17996642-project May 27 15:19:55.480419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:19:55.480419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:19:55.480419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 387048f42b634693a7e827a8d88ef89b May 27 15:19:55.480419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-AttachVolumeTestJSON-17996642-project May 27 15:19:55.480419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:19:55.480419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 could not be found. May 27 15:19:55.480419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': 'f61fd2c2-bca4-412d-93c3-5a3aee3a3b27'} May 27 15:19:55.481217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:19:55.481217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:55.481217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:19:55.481217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:19:55.481217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:19:55.481217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:19:55.481217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:19:55.481217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:19:55.481217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:19:55.481217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:19:55.481217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 could not be found. May 27 15:19:55.481217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:19:55.481217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:55.481217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:19:55.481217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:55.481217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:55.481217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:55.481217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:19:55.481217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:19:55.481217 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:19:55.482579 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:19:55.482579 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:19:55.482579 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:19:55.482579 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:19:55.482579 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:19:55.482579 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:19:55.482579 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:19:55.482579 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 could not be found. May 27 15:19:55.482579 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:19:55.482579 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:19:55.482579 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:19:55.482579 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:19:55.482579 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:19:55.482579 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:19:55.482579 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:19:55.482579 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:19:55.482579 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 could not be found. May 27 15:19:55.482579 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:19:55.483689 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8cda640e-1cce-4e29-8045-1a6de2de02a3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Returning 404 to user: Instance f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:19:55.483689 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-8cda640e-1cce-4e29-8045-1a6de2de02a3 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 404 len: 111 microversion: 2.1 time: 0.044579 May 27 15:19:55.483689 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 346/666] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:55 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:19:55.489402 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-687947d0-e812-4fe4-b032-7c0b347b48e9 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '.version_select at 0x7f57e20be9d0>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:55.508843 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-687947d0-e812-4fe4-b032-7c0b347b48e9 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085007690" status: 202 len: 0 microversion: 2.1 time: 0.023379 May 27 15:19:55.509426 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 321/667] 10.222.0.50 () {58 vars in 1220 bytes} [Fri May 27 15:19:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085007690 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:19:55.911108 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-14d67897-8205-4e86-952d-b5b9f987de53 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:55.911759 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-14d67897-8205-4e86-952d-b5b9f987de53 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:55.918307 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-14d67897-8205-4e86-952d-b5b9f987de53 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:55.918838 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-14d67897-8205-4e86-952d-b5b9f987de53 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:55.919696 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-14d67897-8205-4e86-952d-b5b9f987de53 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:55.920204 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-14d67897-8205-4e86-952d-b5b9f987de53 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:56.168436 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-14d67897-8205-4e86-952d-b5b9f987de53 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:56.176641 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-14d67897-8205-4e86-952d-b5b9f987de53 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1555 microversion: 2.1 time: 0.269755 May 27 15:19:56.177214 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 347/668] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:55 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1555 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:56.217416 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-06c949a9-f189-4778-9507-2321e59cd215 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Action: 'create', calling method: .version_select at 0x7f57e2122160>, body: {"keypair": {"name": "tempest-keypair-1920697467", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPP+cOSt3zvYpXf+jjwkCx9XFQTBP5Id4M+jNDtRw6TMpLuDB6wFG98jQqwlg9TrWPiUYS9shLlL0MyEwXulF1ERHRl7FM/9jDiW1Ox3nBwcOjLg6fDkLHdvPndf1x3glg=="}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:56.231499 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-06c949a9-f189-4778-9507-2321e59cd215 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Getting quotas for project 0bf15a964f8048b48bc794051cd56add. Resources: {'key_pairs'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:19:56.235375 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-06c949a9-f189-4778-9507-2321e59cd215 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Getting quotas for user 387048f42b634693a7e827a8d88ef89b and project 0bf15a964f8048b48bc794051cd56add. Resources: {'key_pairs'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:19:56.258463 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-06c949a9-f189-4778-9507-2321e59cd215 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045038 May 27 15:19:56.259304 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 322/669] 10.222.0.50 () {60 vars in 1158 bytes} [Fri May 27 15:19:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:56.298294 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-5ef9e78b-d119-4ed6-800c-831a02eb7656 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:56.298992 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-5ef9e78b-d119-4ed6-800c-831a02eb7656 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:56.305074 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5ef9e78b-d119-4ed6-800c-831a02eb7656 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:56.305530 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5ef9e78b-d119-4ed6-800c-831a02eb7656 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:56.306296 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5ef9e78b-d119-4ed6-800c-831a02eb7656 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:56.306733 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5ef9e78b-d119-4ed6-800c-831a02eb7656 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:56.466001 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-1f82b6b9-cb0d-4acf-ba0a-87081d2b3925 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:56.466533 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-1f82b6b9-cb0d-4acf-ba0a-87081d2b3925 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:56.477104 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1f82b6b9-cb0d-4acf-ba0a-87081d2b3925 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:56.477738 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1f82b6b9-cb0d-4acf-ba0a-87081d2b3925 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:56.479559 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1f82b6b9-cb0d-4acf-ba0a-87081d2b3925 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:56.480200 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1f82b6b9-cb0d-4acf-ba0a-87081d2b3925 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:56.496198 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5ef9e78b-d119-4ed6-800c-831a02eb7656 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:56.515703 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-5ef9e78b-d119-4ed6-800c-831a02eb7656 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1735 microversion: 2.1 time: 0.221300 May 27 15:19:56.519670 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 348/670] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:56 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:56.650567 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-1f82b6b9-cb0d-4acf-ba0a-87081d2b3925 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:56.658830 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-1f82b6b9-cb0d-4acf-ba0a-87081d2b3925 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:56.660430 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-1f82b6b9-cb0d-4acf-ba0a-87081d2b3925 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:56.661692 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-1f82b6b9-cb0d-4acf-ba0a-87081d2b3925 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1408 microversion: 2.20 time: 0.200579 May 27 15:19:56.662297 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 323/671] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:19:56 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:19:57.193975 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-a17a1ab7-65be-4297-b12f-1c90ba251396 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:57.194581 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-a17a1ab7-65be-4297-b12f-1c90ba251396 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:57.201414 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a17a1ab7-65be-4297-b12f-1c90ba251396 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:57.201855 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a17a1ab7-65be-4297-b12f-1c90ba251396 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:57.202626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a17a1ab7-65be-4297-b12f-1c90ba251396 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:57.203088 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a17a1ab7-65be-4297-b12f-1c90ba251396 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:57.346776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-a17a1ab7-65be-4297-b12f-1c90ba251396 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:57.354460 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-a17a1ab7-65be-4297-b12f-1c90ba251396 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1555 microversion: 2.1 time: 0.164483 May 27 15:19:57.355092 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 349/672] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:57 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:57.534445 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-603461da-822f-497b-b367-6cc49ddfc86f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:57.535072 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-603461da-822f-497b-b367-6cc49ddfc86f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:57.541636 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-603461da-822f-497b-b367-6cc49ddfc86f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:57.542246 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-603461da-822f-497b-b367-6cc49ddfc86f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:57.543209 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-603461da-822f-497b-b367-6cc49ddfc86f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:57.543697 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-603461da-822f-497b-b367-6cc49ddfc86f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:57.680446 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-7fcc822e-42bf-409f-9a8f-505866616485 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:57.681425 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-7fcc822e-42bf-409f-9a8f-505866616485 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:57.689019 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7fcc822e-42bf-409f-9a8f-505866616485 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:57.689480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7fcc822e-42bf-409f-9a8f-505866616485 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:57.690253 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7fcc822e-42bf-409f-9a8f-505866616485 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:57.690720 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7fcc822e-42bf-409f-9a8f-505866616485 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:57.691783 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-603461da-822f-497b-b367-6cc49ddfc86f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:57.701073 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-603461da-822f-497b-b367-6cc49ddfc86f tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1735 microversion: 2.1 time: 0.171196 May 27 15:19:57.701954 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 324/673] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:57 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:57.829312 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-7fcc822e-42bf-409f-9a8f-505866616485 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:57.839274 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-7fcc822e-42bf-409f-9a8f-505866616485 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:57.841040 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-7fcc822e-42bf-409f-9a8f-505866616485 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:57.842496 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-7fcc822e-42bf-409f-9a8f-505866616485 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1408 microversion: 2.20 time: 0.166654 May 27 15:19:57.850896 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 350/674] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:19:57 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:19:58.374494 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-c3616c4b-06ab-4662-9a0c-919b4b88bd13 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-450807626", "imageRef": "a9407644-1f68-43e6-beb1-ce2085766180", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de4024f8-b7b6-4399-919f-5f2498131cc8"}], "security_groups": [{"name": "tempest-securitygroup--1361005885"}], "key_name": "tempest-keypair-1920697467", "user_data": "}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:58.383328 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-5a3c959c-d4fb-457a-9190-6808e86863f4 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:58.384442 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-5a3c959c-d4fb-457a-9190-6808e86863f4 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:58.395947 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5a3c959c-d4fb-457a-9190-6808e86863f4 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:58.396714 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5a3c959c-d4fb-457a-9190-6808e86863f4 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:58.398275 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5a3c959c-d4fb-457a-9190-6808e86863f4 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:58.399067 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5a3c959c-d4fb-457a-9190-6808e86863f4 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:58.549793 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.network.neutron [None req-c3616c4b-06ab-4662-9a0c-919b4b88bd13 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] validate_networks() for [('de4024f8-b7b6-4399-919f-5f2498131cc8', None, None, None, None, None)] {{(pid=117743) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:19:58.667977 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5a3c959c-d4fb-457a-9190-6808e86863f4 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:58.674564 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:58.681610 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-5a3c959c-d4fb-457a-9190-6808e86863f4 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1555 microversion: 2.1 time: 0.305567 May 27 15:19:58.682215 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 351/675] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:58 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1555 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:58.704014 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-16a10405-c4c7-4501-90dc-60fdbd1c92a6 req-d222d5f7-2a09-4b83-bd94-ebb9c3b31105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d29ebf-5c93-4f7c-b372-121a8843600c", "name": "network-vif-deleted", "tag": "499011f1-9fc8-4630-a680-e75f00a1b0e3"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:19:58.716132 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-16a10405-c4c7-4501-90dc-60fdbd1c92a6 req-d222d5f7-2a09-4b83-bd94-ebb9c3b31105 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:58.716576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-16a10405-c4c7-4501-90dc-60fdbd1c92a6 req-d222d5f7-2a09-4b83-bd94-ebb9c3b31105 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:58.737675 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-16a10405-c4c7-4501-90dc-60fdbd1c92a6 req-d222d5f7-2a09-4b83-bd94-ebb9c3b31105 service nova] Creating event network-vif-deleted:499011f1-9fc8-4630-a680-e75f00a1b0e3 for instance c4d29ebf-5c93-4f7c-b372-121a8843600c on hv-cinder-84254 May 27 15:19:58.744798 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-16a10405-c4c7-4501-90dc-60fdbd1c92a6 req-d222d5f7-2a09-4b83-bd94-ebb9c3b31105 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060771 May 27 15:19:58.747465 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 352/676] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:19:58.757559 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f1220569-98b5-4401-8e2b-2c9715d733f6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:58.758935 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f1220569-98b5-4401-8e2b-2c9715d733f6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:58.771556 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f1220569-98b5-4401-8e2b-2c9715d733f6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:58.772342 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f1220569-98b5-4401-8e2b-2c9715d733f6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:58.773687 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f1220569-98b5-4401-8e2b-2c9715d733f6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:58.774454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f1220569-98b5-4401-8e2b-2c9715d733f6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:59.010477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f1220569-98b5-4401-8e2b-2c9715d733f6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:59.022919 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f1220569-98b5-4401-8e2b-2c9715d733f6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1735 microversion: 2.1 time: 0.273902 May 27 15:19:59.023508 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 353/677] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:58 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1735 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:59.113030 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-fcc47f60-860b-433b-b698-d4271c88d05a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:59.113676 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-fcc47f60-860b-433b-b698-d4271c88d05a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:59.120198 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fcc47f60-860b-433b-b698-d4271c88d05a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:59.120744 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fcc47f60-860b-433b-b698-d4271c88d05a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:59.121515 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fcc47f60-860b-433b-b698-d4271c88d05a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:59.121946 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fcc47f60-860b-433b-b698-d4271c88d05a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:59.239119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-c3616c4b-06ab-4662-9a0c-919b4b88bd13 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Flavor limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:19:59.239646 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-c3616c4b-06ab-4662-9a0c-919b4b88bd13 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Image limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:19:59.240198 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-c3616c4b-06ab-4662-9a0c-919b4b88bd13 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Flavor pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:19:59.240620 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-c3616c4b-06ab-4662-9a0c-919b4b88bd13 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Image pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:19:59.241036 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-c3616c4b-06ab-4662-9a0c-919b4b88bd13 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:19:59.250068 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c3616c4b-06ab-4662-9a0c-919b4b88bd13 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:59.251219 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c3616c4b-06ab-4662-9a0c-919b4b88bd13 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:59.252598 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c3616c4b-06ab-4662-9a0c-919b4b88bd13 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:59.253367 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c3616c4b-06ab-4662-9a0c-919b4b88bd13 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:59.275208 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-c3616c4b-06ab-4662-9a0c-919b4b88bd13 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Getting quotas for project 0bf15a964f8048b48bc794051cd56add. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:19:59.281921 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-c3616c4b-06ab-4662-9a0c-919b4b88bd13 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Getting quotas for user 387048f42b634693a7e827a8d88ef89b and project 0bf15a964f8048b48bc794051cd56add. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:19:59.290130 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-fcc47f60-860b-433b-b698-d4271c88d05a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:59.294950 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-c3616c4b-06ab-4662-9a0c-919b4b88bd13 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Going to run 1 instances... {{(pid=117743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:19:59.297229 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-c3616c4b-06ab-4662-9a0c-919b4b88bd13 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9407644-1f68-43e6-beb1-ce2085766180',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:19:59.298127 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-fcc47f60-860b-433b-b698-d4271c88d05a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:59.299938 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-fcc47f60-860b-433b-b698-d4271c88d05a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:59.301111 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-fcc47f60-860b-433b-b698-d4271c88d05a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1408 microversion: 2.20 time: 0.274733 May 27 15:19:59.301672 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 354/678] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:19:59 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1408 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:19:59.348670 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-c3616c4b-06ab-4662-9a0c-919b4b88bd13 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.980464 May 27 15:19:59.349318 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 325/679] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 15:19:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 15:19:59.360528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-28d8574d-11cc-453b-b88c-958426b47169 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:59.361280 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-28d8574d-11cc-453b-b88c-958426b47169 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:59.420474 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-28d8574d-11cc-453b-b88c-958426b47169 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:59.441018 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-28d8574d-11cc-453b-b88c-958426b47169 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1237 microversion: 2.1 time: 0.085467 May 27 15:19:59.443011 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 355/680] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:59 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:19:59.704367 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-4c1df214-4882-4c5f-a5bc-8b53486b9f51 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:19:59.705780 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-4c1df214-4882-4c5f-a5bc-8b53486b9f51 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:19:59.712246 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4c1df214-4882-4c5f-a5bc-8b53486b9f51 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:59.714308 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4c1df214-4882-4c5f-a5bc-8b53486b9f51 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:59.714308 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4c1df214-4882-4c5f-a5bc-8b53486b9f51 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:59.714308 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4c1df214-4882-4c5f-a5bc-8b53486b9f51 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:59.750708 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=100 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:19:59.769547 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4c1df214-4882-4c5f-a5bc-8b53486b9f51 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:19:59.770077 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4c1df214-4882-4c5f-a5bc-8b53486b9f51 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:19:59.770598 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.objects.instance [None req-4c1df214-4882-4c5f-a5bc-8b53486b9f51 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lazy-loading 'fault' on Instance uuid c4d29ebf-5c93-4f7c-b372-121a8843600c {{(pid=117743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:19:59.813373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-4c1df214-4882-4c5f-a5bc-8b53486b9f51 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:19:59.821683 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-4c1df214-4882-4c5f-a5bc-8b53486b9f51 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1348 microversion: 2.1 time: 0.122985 May 27 15:19:59.822267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 326/681] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:19:59 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1348 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:00.042571 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ecc1877c-d201-46ea-98ca-3983d95d08df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:00.043222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ecc1877c-d201-46ea-98ca-3983d95d08df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:00.045176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=2 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:00.052418 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ecc1877c-d201-46ea-98ca-3983d95d08df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:00.053004 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ecc1877c-d201-46ea-98ca-3983d95d08df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:00.053886 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ecc1877c-d201-46ea-98ca-3983d95d08df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:00.054331 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ecc1877c-d201-46ea-98ca-3983d95d08df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:00.193601 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-ecc1877c-d201-46ea-98ca-3983d95d08df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:00.201458 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ecc1877c-d201-46ea-98ca-3983d95d08df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1715 microversion: 2.1 time: 0.162810 May 27 15:20:00.202017 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 356/682] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:00 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1715 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:00.307306 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-c04053ff-d633-4509-beab-66622ce8e0ab tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:00.307809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-c04053ff-d633-4509-beab-66622ce8e0ab tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:00.313930 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c04053ff-d633-4509-beab-66622ce8e0ab tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:00.314375 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c04053ff-d633-4509-beab-66622ce8e0ab tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:00.315301 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c04053ff-d633-4509-beab-66622ce8e0ab tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:00.315749 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c04053ff-d633-4509-beab-66622ce8e0ab tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:00.320006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-dc3f6524-ffc8-42ba-b45d-e49f4356193f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:00.320603 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-dc3f6524-ffc8-42ba-b45d-e49f4356193f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:00.326609 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-dc3f6524-ffc8-42ba-b45d-e49f4356193f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:00.327095 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-dc3f6524-ffc8-42ba-b45d-e49f4356193f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:00.327842 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-dc3f6524-ffc8-42ba-b45d-e49f4356193f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:00.328269 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-dc3f6524-ffc8-42ba-b45d-e49f4356193f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:00.448876 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-c04053ff-d633-4509-beab-66622ce8e0ab tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] HTTP exception thrown: Cannot 'detach_volume' instance 5b91f595-1d49-4eed-8d8c-57bb287d34b5 while it is in vm_state rescued May 27 15:20:00.450497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-c04053ff-d633-4509-beab-66622ce8e0ab tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Request method failure captured: May 27 15:20:00.450497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: DELETE /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5/os-volume_attachments/36e5f894-423a-45b0-bfdc-0e96d179895c HTTP/1.1 May 27 15:20:00.450497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:20:00.450497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:20:00.450497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:20:00.450497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 0 May 27 15:20:00.450497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:20:00.450497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:20:00.450497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:20:00.450497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:20:00.450497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOsskJv0Za1_r4uQKA_pi415_6wML-p1mRVGBWD8lWuud7bzAGolysbWk-OZBZUDOlh33cVz8_cStEJa1_A3rWwn3mlg65e6M9osS70eYm9HT9aGfMK1PAt0mA1rcJnxNqZvqN2lltoyozOfD_R1N4W67Q6b0UC8RqROVyLsQCTGw-I May 27 15:20:00.450497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:20:00.450497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:20:00.450497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:20:00.450497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:20:00.450497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:20:00.450497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:20:00.450497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: c208c3d86c504ea086bf763e241cbc88 May 27 15:20:00.450497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1899191250 May 27 15:20:00.450497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:20:00.450497 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:20:00.453433 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c208c3d86c504ea086bf763e241cbc88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c208c3d86c504ea086bf763e241cbc88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c208c3d86c504ea086bf763e241cbc88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c208c3d86c504ea086bf763e241cbc88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:20:00.453433 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1899191250 May 27 15:20:00.453433 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: c208c3d86c504ea086bf763e241cbc88 May 27 15:20:00.453433 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1899191250 May 27 15:20:00.453433 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-ServerRescueNegativeTestJSON-1899191250-project May 27 15:20:00.453433 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:20:00.453433 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:20:00.453433 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: 9c9149cb2b3c423796164b487a305bbd May 27 15:20:00.453433 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1899191250-project May 27 15:20:00.453433 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: > May 27 15:20:00.453433 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Cannot 'detach_volume' instance 5b91f595-1d49-4eed-8d8c-57bb287d34b5 while it is in vm_state rescued May 27 15:20:00.454752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'server_id': '5b91f595-1d49-4eed-8d8c-57bb287d34b5', 'id': '36e5f894-423a-45b0-bfdc-0e96d179895c'} May 27 15:20:00.454752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:20:00.454752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:00.454752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 27 15:20:00.454752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 27 15:20:00.454752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:20:00.454752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:20:00.454752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 15:20:00.454752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 15:20:00.454752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5b91f595-1d49-4eed-8d8c-57bb287d34b5 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 27 15:20:00.454752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:00.454752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:00.454752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:00.454752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:00.454752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:00.454752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:00.454752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:20:00.454752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:20:00.454752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:20:00.454752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:20:00.457273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 27 15:20:00.457273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 15:20:00.457273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 15:20:00.457273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 15:20:00.457273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5b91f595-1d49-4eed-8d8c-57bb287d34b5 while it is in vm_state rescued May 27 15:20:00.457273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:00.457273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:00.457273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:00.457273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:00.457273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:00.457273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:00.457273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:20:00.457273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:20:00.457273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5b91f595-1d49-4eed-8d8c-57bb287d34b5 while it is in vm_state rescued May 27 15:20:00.457273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:00.457273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-c04053ff-d633-4509-beab-66622ce8e0ab tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Returning 409 to user: Cannot 'detach_volume' instance 5b91f595-1d49-4eed-8d8c-57bb287d34b5 while it is in vm_state rescued {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:20:00.459485 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-c04053ff-d633-4509-beab-66622ce8e0ab tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5/os-volume_attachments/36e5f894-423a-45b0-bfdc-0e96d179895c" status: 409 len: 152 microversion: 2.1 time: 0.149205 May 27 15:20:00.459485 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 327/683] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 15:20:00 2022] DELETE /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5/os-volume_attachments/36e5f894-423a-45b0-bfdc-0e96d179895c => generated 152 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 15:20:00.459485 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-c13ed95b-4a29-464f-85a6-f1c724d4fa7c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:00.459983 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-c13ed95b-4a29-464f-85a6-f1c724d4fa7c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:00.466974 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c13ed95b-4a29-464f-85a6-f1c724d4fa7c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:00.467413 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c13ed95b-4a29-464f-85a6-f1c724d4fa7c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:00.468185 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c13ed95b-4a29-464f-85a6-f1c724d4fa7c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:00.468634 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c13ed95b-4a29-464f-85a6-f1c724d4fa7c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:00.473873 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-dc3f6524-ffc8-42ba-b45d-e49f4356193f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:00.482480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-dc3f6524-ffc8-42ba-b45d-e49f4356193f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:00.484030 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-dc3f6524-ffc8-42ba-b45d-e49f4356193f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:00.485157 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-dc3f6524-ffc8-42ba-b45d-e49f4356193f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1408 microversion: 2.20 time: 0.169028 May 27 15:20:00.485814 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 357/684] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:20:00 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:20:00.496328 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-2a7d917b-412a-4072-95eb-c2362096173a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:00.496869 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-2a7d917b-412a-4072-95eb-c2362096173a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:00.503899 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2a7d917b-412a-4072-95eb-c2362096173a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:00.504354 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2a7d917b-412a-4072-95eb-c2362096173a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:00.505136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2a7d917b-412a-4072-95eb-c2362096173a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:00.505577 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2a7d917b-412a-4072-95eb-c2362096173a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:00.540355 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-c13ed95b-4a29-464f-85a6-f1c724d4fa7c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:00.547967 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-c13ed95b-4a29-464f-85a6-f1c724d4fa7c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1241 microversion: 2.1 time: 0.093512 May 27 15:20:00.549473 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 328/685] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:00 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:00.581937 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-2a7d917b-412a-4072-95eb-c2362096173a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "POST /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5/action" status: 202 len: 0 microversion: 2.1 time: 0.092918 May 27 15:20:00.582732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 358/686] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 15:20:00 2022] POST /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:20:00.591249 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-98ec837f-b9dd-4047-ab9b-628da398bb8b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:00.591892 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-98ec837f-b9dd-4047-ab9b-628da398bb8b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:00.598774 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-98ec837f-b9dd-4047-ab9b-628da398bb8b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:00.599263 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-98ec837f-b9dd-4047-ab9b-628da398bb8b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:00.600020 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-98ec837f-b9dd-4047-ab9b-628da398bb8b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:00.600453 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-98ec837f-b9dd-4047-ab9b-628da398bb8b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:00.732778 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-98ec837f-b9dd-4047-ab9b-628da398bb8b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:00.741637 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-98ec837f-b9dd-4047-ab9b-628da398bb8b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1723 microversion: 2.1 time: 0.154393 May 27 15:20:00.742210 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 329/687] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:00 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:00.839116 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-7ec1c9ab-3686-4644-a5f3-3a4434e62d1b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:00.839806 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-7ec1c9ab-3686-4644-a5f3-3a4434e62d1b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:00.846803 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7ec1c9ab-3686-4644-a5f3-3a4434e62d1b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:00.847275 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7ec1c9ab-3686-4644-a5f3-3a4434e62d1b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:00.848033 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7ec1c9ab-3686-4644-a5f3-3a4434e62d1b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:00.848470 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7ec1c9ab-3686-4644-a5f3-3a4434e62d1b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:00.880428 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7ec1c9ab-3686-4644-a5f3-3a4434e62d1b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:00.880900 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7ec1c9ab-3686-4644-a5f3-3a4434e62d1b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:00.881350 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.objects.instance [None req-7ec1c9ab-3686-4644-a5f3-3a4434e62d1b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lazy-loading 'fault' on Instance uuid c4d29ebf-5c93-4f7c-b372-121a8843600c {{(pid=117742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:00.924099 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-7ec1c9ab-3686-4644-a5f3-3a4434e62d1b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ca9d699b004df4becfe3241802fb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7facd29ad0d746099537a1b1345c2c90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:00.931862 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-7ec1c9ab-3686-4644-a5f3-3a4434e62d1b tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 200 len: 1348 microversion: 2.1 time: 0.097028 May 27 15:20:00.932439 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 359/688] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:00 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 1348 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:01.509468 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b739d720-8aed-4d8f-8371-7bfb80f55386 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:01.510069 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b739d720-8aed-4d8f-8371-7bfb80f55386 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:01.516197 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b739d720-8aed-4d8f-8371-7bfb80f55386 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:01.516646 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b739d720-8aed-4d8f-8371-7bfb80f55386 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:01.517665 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b739d720-8aed-4d8f-8371-7bfb80f55386 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:01.518218 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b739d720-8aed-4d8f-8371-7bfb80f55386 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:01.568332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-04c94af0-999f-4d8b-a7c6-8742b1a409ab tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:01.568950 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-04c94af0-999f-4d8b-a7c6-8742b1a409ab tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:01.581325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-04c94af0-999f-4d8b-a7c6-8742b1a409ab tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:01.581685 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-04c94af0-999f-4d8b-a7c6-8742b1a409ab tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:01.582652 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-04c94af0-999f-4d8b-a7c6-8742b1a409ab tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:01.586114 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-04c94af0-999f-4d8b-a7c6-8742b1a409ab tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:01.697208 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-04c94af0-999f-4d8b-a7c6-8742b1a409ab tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:01.712041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-04c94af0-999f-4d8b-a7c6-8742b1a409ab tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1289 microversion: 2.1 time: 0.148123 May 27 15:20:01.714085 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 360/689] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:01 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1289 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:01.718523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b739d720-8aed-4d8f-8371-7bfb80f55386 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:01.729894 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b739d720-8aed-4d8f-8371-7bfb80f55386 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:01.731977 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b739d720-8aed-4d8f-8371-7bfb80f55386 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:01.734285 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b739d720-8aed-4d8f-8371-7bfb80f55386 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1408 microversion: 2.20 time: 0.228252 May 27 15:20:01.735490 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 330/690] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:20:01 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:01.761556 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-a49f05f1-e052-4f77-87f1-5e0aa57b257d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:01.762310 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-a49f05f1-e052-4f77-87f1-5e0aa57b257d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:01.769737 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a49f05f1-e052-4f77-87f1-5e0aa57b257d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:01.770230 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a49f05f1-e052-4f77-87f1-5e0aa57b257d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:01.771058 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a49f05f1-e052-4f77-87f1-5e0aa57b257d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:01.771497 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a49f05f1-e052-4f77-87f1-5e0aa57b257d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:01.950753 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-a49f05f1-e052-4f77-87f1-5e0aa57b257d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:01.953285 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-1b89946c-9611-44bf-9367-d858508cb1b3 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:01.955118 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-1b89946c-9611-44bf-9367-d858508cb1b3 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] [instance: c4d29ebf-5c93-4f7c-b372-121a8843600c] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:01.966875 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-a49f05f1-e052-4f77-87f1-5e0aa57b257d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1723 microversion: 2.1 time: 0.210368 May 27 15:20:01.984560 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 361/691] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:01 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:01.993864 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1b89946c-9611-44bf-9367-d858508cb1b3 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:01.995304 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1b89946c-9611-44bf-9367-d858508cb1b3 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:01.996931 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1b89946c-9611-44bf-9367-d858508cb1b3 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:01.998037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1b89946c-9611-44bf-9367-d858508cb1b3 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:02.028351 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-1b89946c-9611-44bf-9367-d858508cb1b3 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] HTTP exception thrown: Instance c4d29ebf-5c93-4f7c-b372-121a8843600c could not be found. May 27 15:20:02.031947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-1b89946c-9611-44bf-9367-d858508cb1b3 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Request method failure captured: May 27 15:20:02.031947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c HTTP/1.1 May 27 15:20:02.031947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:20:02.031947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:20:02.031947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:20:02.031947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 0 May 27 15:20:02.031947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:20:02.031947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:20:02.031947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:20:02.031947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:20:02.031947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOsqeNnkoVBiAdkJHmdMDXCJgCNP4WKoWr-AxgQmUyS7Q6km3jDRWkUDCFYji1DBgXfxxcF4PV4xtQMaP6FRsrjOWAwo7hZnEdif8_ba0j43HNmkdq8nSzsuRjaUZ_KYhUeNxhL95Cx7WIyc74Io84Ceinj5P4g623ANSw2XY0Nxnsg May 27 15:20:02.031947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:20:02.031947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:20:02.031947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:20:02.031947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:20:02.031947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:20:02.031947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:20:02.031947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: 7facd29ad0d746099537a1b1345c2c90 May 27 15:20:02.031947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-TestMinimumBasicScenario-834081231 May 27 15:20:02.031947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:20:02.031947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:20:02.035361 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7facd29ad0d746099537a1b1345c2c90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7facd29ad0d746099537a1b1345c2c90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7facd29ad0d746099537a1b1345c2c90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7facd29ad0d746099537a1b1345c2c90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:20:02.035361 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-TestMinimumBasicScenario-834081231 May 27 15:20:02.035361 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: 7facd29ad0d746099537a1b1345c2c90 May 27 15:20:02.035361 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-TestMinimumBasicScenario-834081231 May 27 15:20:02.035361 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-TestMinimumBasicScenario-834081231-project May 27 15:20:02.035361 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:20:02.035361 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:20:02.035361 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: 50ca9d699b004df4becfe3241802fb17 May 27 15:20:02.035361 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-TestMinimumBasicScenario-834081231-project May 27 15:20:02.035361 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: > May 27 15:20:02.035361 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Instance c4d29ebf-5c93-4f7c-b372-121a8843600c could not be found. May 27 15:20:02.035361 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'id': 'c4d29ebf-5c93-4f7c-b372-121a8843600c'} May 27 15:20:02.036964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:20:02.036964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:02.036964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:20:02.036964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:20:02.036964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:20:02.036964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:20:02.036964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:20:02.036964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:20:02.036964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:20:02.036964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:20:02.036964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4d29ebf-5c93-4f7c-b372-121a8843600c could not be found. May 27 15:20:02.036964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:02.036964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:02.036964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:02.036964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:02.036964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:02.036964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:02.036964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:20:02.036964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:20:02.036964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:20:02.040525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:20:02.040525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:20:02.040525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:20:02.040525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:20:02.040525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:20:02.040525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:20:02.040525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:20:02.040525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4d29ebf-5c93-4f7c-b372-121a8843600c could not be found. May 27 15:20:02.040525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:02.040525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:02.040525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:02.040525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:02.040525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:02.040525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:02.040525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:20:02.040525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:20:02.040525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d29ebf-5c93-4f7c-b372-121a8843600c could not be found. May 27 15:20:02.040525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:02.044014 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-1b89946c-9611-44bf-9367-d858508cb1b3 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Returning 404 to user: Instance c4d29ebf-5c93-4f7c-b372-121a8843600c could not be found. {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:20:02.045018 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-1b89946c-9611-44bf-9367-d858508cb1b3 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c" status: 404 len: 111 microversion: 2.1 time: 0.100031 May 27 15:20:02.045862 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 331/692] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:01 2022] GET /compute/v2.1/servers/c4d29ebf-5c93-4f7c-b372-121a8843600c => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:20:02.055003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-fc02448d-95a0-4f37-a9c7-3f6ee1c97d60 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] Calling method '.version_select at 0x7f57e16f6550>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:02.073269 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-fc02448d-95a0-4f37-a9c7-3f6ee1c97d60 tempest-TestMinimumBasicScenario-834081231 tempest-TestMinimumBasicScenario-834081231-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1655432015" status: 202 len: 0 microversion: 2.1 time: 0.022422 May 27 15:20:02.073839 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 362/693] 10.222.0.50 () {58 vars in 1271 bytes} [Fri May 27 15:20:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1655432015 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:20:02.739291 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9e6cac93-b9da-4687-a4c3-6cf0e32f9cd0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:02.744510 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9e6cac93-b9da-4687-a4c3-6cf0e32f9cd0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:02.761505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-36d7c05e-7e3b-4f76-832d-73acbb7dd12a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:02.766159 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-36d7c05e-7e3b-4f76-832d-73acbb7dd12a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:02.782901 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9e6cac93-b9da-4687-a4c3-6cf0e32f9cd0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:02.786784 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9e6cac93-b9da-4687-a4c3-6cf0e32f9cd0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:02.787859 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9e6cac93-b9da-4687-a4c3-6cf0e32f9cd0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:02.788460 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9e6cac93-b9da-4687-a4c3-6cf0e32f9cd0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:02.788690 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-36d7c05e-7e3b-4f76-832d-73acbb7dd12a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:02.789728 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-36d7c05e-7e3b-4f76-832d-73acbb7dd12a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:02.794199 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-36d7c05e-7e3b-4f76-832d-73acbb7dd12a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:02.795248 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-36d7c05e-7e3b-4f76-832d-73acbb7dd12a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:02.978970 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9e6cac93-b9da-4687-a4c3-6cf0e32f9cd0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:02.997978 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9e6cac93-b9da-4687-a4c3-6cf0e32f9cd0 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1295 microversion: 2.1 time: 0.269326 May 27 15:20:03.002327 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 332/694] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:02 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1295 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:03.016923 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-ef41debd-24cc-4eee-b492-ddc209d25d08 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:03.017995 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-ef41debd-24cc-4eee-b492-ddc209d25d08 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:03.030768 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ef41debd-24cc-4eee-b492-ddc209d25d08 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:03.031991 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ef41debd-24cc-4eee-b492-ddc209d25d08 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:03.034561 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ef41debd-24cc-4eee-b492-ddc209d25d08 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:03.035406 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ef41debd-24cc-4eee-b492-ddc209d25d08 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:03.428302 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-36d7c05e-7e3b-4f76-832d-73acbb7dd12a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:03.444502 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-36d7c05e-7e3b-4f76-832d-73acbb7dd12a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:03.448521 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-36d7c05e-7e3b-4f76-832d-73acbb7dd12a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:03.451243 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-36d7c05e-7e3b-4f76-832d-73acbb7dd12a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1408 microversion: 2.20 time: 0.697484 May 27 15:20:03.452598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 363/695] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:20:02 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1408 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:03.548959 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-ef41debd-24cc-4eee-b492-ddc209d25d08 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:03.557624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-ef41debd-24cc-4eee-b492-ddc209d25d08 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1723 microversion: 2.1 time: 0.553457 May 27 15:20:03.558211 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 333/696] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:03 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1723 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:04.018642 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-616af77b-66f4-4a49-847c-317559eea538 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:04.019356 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-616af77b-66f4-4a49-847c-317559eea538 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:04.026156 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-616af77b-66f4-4a49-847c-317559eea538 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:04.026597 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-616af77b-66f4-4a49-847c-317559eea538 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:04.027409 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-616af77b-66f4-4a49-847c-317559eea538 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:04.027819 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-616af77b-66f4-4a49-847c-317559eea538 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:04.246700 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-616af77b-66f4-4a49-847c-317559eea538 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:04.255282 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-616af77b-66f4-4a49-847c-317559eea538 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1363 microversion: 2.1 time: 0.241017 May 27 15:20:04.255874 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 364/697] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:04 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:04.476132 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-51a9f943-f677-4ce7-bade-35296a6fcaf5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:04.483311 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-51a9f943-f677-4ce7-bade-35296a6fcaf5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:04.495388 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-51a9f943-f677-4ce7-bade-35296a6fcaf5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:04.496285 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-51a9f943-f677-4ce7-bade-35296a6fcaf5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:04.497743 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-51a9f943-f677-4ce7-bade-35296a6fcaf5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:04.498640 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-51a9f943-f677-4ce7-bade-35296a6fcaf5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:04.585707 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-29ef703e-6457-46b3-93ac-24b15d7884ef tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:04.586475 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-29ef703e-6457-46b3-93ac-24b15d7884ef tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:04.596695 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-29ef703e-6457-46b3-93ac-24b15d7884ef tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:04.597287 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-29ef703e-6457-46b3-93ac-24b15d7884ef tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:04.598240 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-29ef703e-6457-46b3-93ac-24b15d7884ef tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:04.598970 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-29ef703e-6457-46b3-93ac-24b15d7884ef tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:04.773303 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-51a9f943-f677-4ce7-bade-35296a6fcaf5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:04.783449 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-51a9f943-f677-4ce7-bade-35296a6fcaf5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:04.785507 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-51a9f943-f677-4ce7-bade-35296a6fcaf5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:04.786635 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-51a9f943-f677-4ce7-bade-35296a6fcaf5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1408 microversion: 2.20 time: 0.318745 May 27 15:20:04.787229 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 334/698] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:20:04 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1408 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:04.811804 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-66f4b78e-95a0-4ae4-9ff2-ed3e7b4248ca tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:04.812482 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-66f4b78e-95a0-4ae4-9ff2-ed3e7b4248ca tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:04.819416 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-66f4b78e-95a0-4ae4-9ff2-ed3e7b4248ca tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:04.819866 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-66f4b78e-95a0-4ae4-9ff2-ed3e7b4248ca tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:04.820737 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-66f4b78e-95a0-4ae4-9ff2-ed3e7b4248ca tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:04.821175 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-66f4b78e-95a0-4ae4-9ff2-ed3e7b4248ca tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:04.849323 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-66f4b78e-95a0-4ae4-9ff2-ed3e7b4248ca tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Going to try to terminate instance {{(pid=117743) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:20:04.869458 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-29ef703e-6457-46b3-93ac-24b15d7884ef tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:04.883994 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-29ef703e-6457-46b3-93ac-24b15d7884ef tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1723 microversion: 2.1 time: 0.302774 May 27 15:20:04.893347 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 365/699] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:04 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:04.949460 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-66f4b78e-95a0-4ae4-9ff2-ed3e7b4248ca tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 204 len: 0 microversion: 2.1 time: 0.141506 May 27 15:20:04.950052 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 335/700] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:20:04 2022] DELETE /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:20:04.959131 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-15e562cc-f321-47ba-b9ab-29a32a14dd44 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:04.959738 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-15e562cc-f321-47ba-b9ab-29a32a14dd44 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:04.966242 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-15e562cc-f321-47ba-b9ab-29a32a14dd44 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:04.966689 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-15e562cc-f321-47ba-b9ab-29a32a14dd44 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:04.967486 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-15e562cc-f321-47ba-b9ab-29a32a14dd44 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:04.967913 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-15e562cc-f321-47ba-b9ab-29a32a14dd44 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:05.188866 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-15e562cc-f321-47ba-b9ab-29a32a14dd44 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:05.196838 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-15e562cc-f321-47ba-b9ab-29a32a14dd44 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1576 microversion: 2.1 time: 0.241873 May 27 15:20:05.197425 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 366/701] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:04 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1576 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:05.276348 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-61be5c42-ece4-44ba-8e6d-e740a476301f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:05.277257 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-61be5c42-ece4-44ba-8e6d-e740a476301f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:05.287125 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-61be5c42-ece4-44ba-8e6d-e740a476301f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:05.287717 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-61be5c42-ece4-44ba-8e6d-e740a476301f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:05.288695 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-61be5c42-ece4-44ba-8e6d-e740a476301f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:05.289427 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-61be5c42-ece4-44ba-8e6d-e740a476301f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:05.562656 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-61be5c42-ece4-44ba-8e6d-e740a476301f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:05.575736 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-61be5c42-ece4-44ba-8e6d-e740a476301f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1363 microversion: 2.1 time: 0.304652 May 27 15:20:05.577559 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 336/702] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:05 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:05.661083 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-f70b8abd-3e42-4781-9a74-9494083744eb req-a8deb701-0dbe-4d4d-82d6-251c3d1acd4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1c52039-f595-4f22-9df9-ea3a999f55fe", "name": "network-vif-plugged", "status": "completed", "tag": "00ae88d7-8fbc-40d5-aefb-819837b95c30"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:05.672535 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-f70b8abd-3e42-4781-9a74-9494083744eb req-a8deb701-0dbe-4d4d-82d6-251c3d1acd4c service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:05.673789 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-f70b8abd-3e42-4781-9a74-9494083744eb req-a8deb701-0dbe-4d4d-82d6-251c3d1acd4c service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:05.687231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-f70b8abd-3e42-4781-9a74-9494083744eb req-a8deb701-0dbe-4d4d-82d6-251c3d1acd4c service nova] Creating event network-vif-plugged:00ae88d7-8fbc-40d5-aefb-819837b95c30 for instance f1c52039-f595-4f22-9df9-ea3a999f55fe on hv-cinder-84254 May 27 15:20:05.694724 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-f70b8abd-3e42-4781-9a74-9494083744eb req-a8deb701-0dbe-4d4d-82d6-251c3d1acd4c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043893 May 27 15:20:05.695929 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 367/703] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:05.808076 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-2552dfba-7494-4c33-82f7-a38e54b43b5e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:05.809024 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-2552dfba-7494-4c33-82f7-a38e54b43b5e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:05.816758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2552dfba-7494-4c33-82f7-a38e54b43b5e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:05.817577 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2552dfba-7494-4c33-82f7-a38e54b43b5e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:05.818569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2552dfba-7494-4c33-82f7-a38e54b43b5e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:05.819100 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2552dfba-7494-4c33-82f7-a38e54b43b5e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:05.921923 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-4faf2051-d2c3-4b5f-94d1-1ec514e0e3a2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:05.923503 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-4faf2051-d2c3-4b5f-94d1-1ec514e0e3a2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:05.928955 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:05.936550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4faf2051-d2c3-4b5f-94d1-1ec514e0e3a2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:05.937239 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4faf2051-d2c3-4b5f-94d1-1ec514e0e3a2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:05.938292 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4faf2051-d2c3-4b5f-94d1-1ec514e0e3a2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:05.939832 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4faf2051-d2c3-4b5f-94d1-1ec514e0e3a2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:05.995132 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-2552dfba-7494-4c33-82f7-a38e54b43b5e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:06.004349 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-2552dfba-7494-4c33-82f7-a38e54b43b5e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:06.005851 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-2552dfba-7494-4c33-82f7-a38e54b43b5e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:06.007133 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-2552dfba-7494-4c33-82f7-a38e54b43b5e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1408 microversion: 2.20 time: 0.204185 May 27 15:20:06.007704 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 337/704] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:20:05 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:06.110276 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-4faf2051-d2c3-4b5f-94d1-1ec514e0e3a2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:06.119011 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-4faf2051-d2c3-4b5f-94d1-1ec514e0e3a2 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1723 microversion: 2.1 time: 0.202633 May 27 15:20:06.119798 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 368/705] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:05 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:06.227266 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b156f55b-2929-4b18-b565-0aceccf985a1 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:06.239377 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b156f55b-2929-4b18-b565-0aceccf985a1 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:06.250203 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b156f55b-2929-4b18-b565-0aceccf985a1 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:06.251564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b156f55b-2929-4b18-b565-0aceccf985a1 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:06.253335 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b156f55b-2929-4b18-b565-0aceccf985a1 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:06.254745 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b156f55b-2929-4b18-b565-0aceccf985a1 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:06.536058 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b156f55b-2929-4b18-b565-0aceccf985a1 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:06.543879 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b156f55b-2929-4b18-b565-0aceccf985a1 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1576 microversion: 2.1 time: 0.325743 May 27 15:20:06.544453 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 338/706] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:06 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1576 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:06.594889 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-d8c888b9-1a1c-4c39-ba62-f145fbb49fdb tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:06.595679 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-d8c888b9-1a1c-4c39-ba62-f145fbb49fdb tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:06.605957 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d8c888b9-1a1c-4c39-ba62-f145fbb49fdb tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:06.606686 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d8c888b9-1a1c-4c39-ba62-f145fbb49fdb tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:06.607996 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d8c888b9-1a1c-4c39-ba62-f145fbb49fdb tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:06.609099 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d8c888b9-1a1c-4c39-ba62-f145fbb49fdb tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:06.857780 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-d8c888b9-1a1c-4c39-ba62-f145fbb49fdb tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:06.873174 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-d8c888b9-1a1c-4c39-ba62-f145fbb49fdb tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1363 microversion: 2.1 time: 0.282318 May 27 15:20:06.874679 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 369/707] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:06 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:07.033826 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-44003d97-53fe-442e-b95a-232223b6a7c9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:07.035260 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-44003d97-53fe-442e-b95a-232223b6a7c9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:07.069199 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-44003d97-53fe-442e-b95a-232223b6a7c9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:07.069661 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-44003d97-53fe-442e-b95a-232223b6a7c9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:07.070461 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-44003d97-53fe-442e-b95a-232223b6a7c9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:07.070929 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-44003d97-53fe-442e-b95a-232223b6a7c9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:07.172103 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-5db8e8f6-2908-4f5c-9203-3e915733eb61 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:07.174836 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-5db8e8f6-2908-4f5c-9203-3e915733eb61 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:07.187423 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5db8e8f6-2908-4f5c-9203-3e915733eb61 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:07.188817 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5db8e8f6-2908-4f5c-9203-3e915733eb61 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:07.194467 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5db8e8f6-2908-4f5c-9203-3e915733eb61 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:07.196014 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5db8e8f6-2908-4f5c-9203-3e915733eb61 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:07.237042 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:07.507835 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-44003d97-53fe-442e-b95a-232223b6a7c9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:07.529397 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5db8e8f6-2908-4f5c-9203-3e915733eb61 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:07.551013 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-44003d97-53fe-442e-b95a-232223b6a7c9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:07.554015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-44003d97-53fe-442e-b95a-232223b6a7c9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:07.555220 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-44003d97-53fe-442e-b95a-232223b6a7c9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1408 microversion: 2.20 time: 0.527421 May 27 15:20:07.561844 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-5db8e8f6-2908-4f5c-9203-3e915733eb61 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1723 microversion: 2.1 time: 0.420781 May 27 15:20:07.563574 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 339/708] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:20:07 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1408 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:07.565290 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 370/709] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:07 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1723 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:07.570388 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-3a465ba1-375c-49ec-9573-785810156db8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:07.571292 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-3a465ba1-375c-49ec-9573-785810156db8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:07.586730 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3a465ba1-375c-49ec-9573-785810156db8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:07.587538 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3a465ba1-375c-49ec-9573-785810156db8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:07.596968 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3a465ba1-375c-49ec-9573-785810156db8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:07.597496 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3a465ba1-375c-49ec-9573-785810156db8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:07.891614 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-1bcce599-8e9c-4adb-b3fd-ce31fc4527ae tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:07.893733 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-1bcce599-8e9c-4adb-b3fd-ce31fc4527ae tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:07.901525 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1bcce599-8e9c-4adb-b3fd-ce31fc4527ae tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:07.902200 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1bcce599-8e9c-4adb-b3fd-ce31fc4527ae tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:07.903669 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1bcce599-8e9c-4adb-b3fd-ce31fc4527ae tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:07.904335 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1bcce599-8e9c-4adb-b3fd-ce31fc4527ae tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:08.236829 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-3a465ba1-375c-49ec-9573-785810156db8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:08.256474 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-3a465ba1-375c-49ec-9573-785810156db8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1576 microversion: 2.1 time: 0.689728 May 27 15:20:08.257064 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 340/710] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:07 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1576 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:08.261644 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-415e9671-beee-441e-8f1f-e60689ddb91c req-7f2be4d4-bb51-49ce-a442-464f59e696f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe4a7119-2de1-4f92-a310-bdd2eb2aa316", "tag": "37e04985-41a3-46a7-bd4a-0d11189b7fbf"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:08.265402 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:08.275835 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-415e9671-beee-441e-8f1f-e60689ddb91c req-7f2be4d4-bb51-49ce-a442-464f59e696f3 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:08.276577 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-415e9671-beee-441e-8f1f-e60689ddb91c req-7f2be4d4-bb51-49ce-a442-464f59e696f3 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:08.294151 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-415e9671-beee-441e-8f1f-e60689ddb91c req-7f2be4d4-bb51-49ce-a442-464f59e696f3 service nova] Creating event network-changed:37e04985-41a3-46a7-bd4a-0d11189b7fbf for instance fe4a7119-2de1-4f92-a310-bdd2eb2aa316 on hv-cinder-84254 May 27 15:20:08.300377 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-415e9671-beee-441e-8f1f-e60689ddb91c req-7f2be4d4-bb51-49ce-a442-464f59e696f3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041870 May 27 15:20:08.301207 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 341/711] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:08.458664 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-1bcce599-8e9c-4adb-b3fd-ce31fc4527ae tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:08.466173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-1bcce599-8e9c-4adb-b3fd-ce31fc4527ae tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1363 microversion: 2.1 time: 0.578472 May 27 15:20:08.466741 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 371/712] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:07 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1363 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:08.612286 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-1c4ae082-2941-4e45-9fdf-38cfd11d0f3a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:08.612978 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-1c4ae082-2941-4e45-9fdf-38cfd11d0f3a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:08.620977 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1c4ae082-2941-4e45-9fdf-38cfd11d0f3a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:08.621419 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1c4ae082-2941-4e45-9fdf-38cfd11d0f3a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:08.622270 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1c4ae082-2941-4e45-9fdf-38cfd11d0f3a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:08.622511 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-a4283a9f-abc5-489c-92b4-410991f6fe88 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:08.622695 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1c4ae082-2941-4e45-9fdf-38cfd11d0f3a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:08.623310 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-a4283a9f-abc5-489c-92b4-410991f6fe88 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:08.628029 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:08.631238 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a4283a9f-abc5-489c-92b4-410991f6fe88 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:08.631895 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a4283a9f-abc5-489c-92b4-410991f6fe88 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:08.632741 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a4283a9f-abc5-489c-92b4-410991f6fe88 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:08.633431 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a4283a9f-abc5-489c-92b4-410991f6fe88 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:08.903673 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-1c4ae082-2941-4e45-9fdf-38cfd11d0f3a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:08.912524 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-1c4ae082-2941-4e45-9fdf-38cfd11d0f3a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:08.913674 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-1c4ae082-2941-4e45-9fdf-38cfd11d0f3a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:08.914785 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-1c4ae082-2941-4e45-9fdf-38cfd11d0f3a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1408 microversion: 2.20 time: 0.307247 May 27 15:20:08.915372 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 342/713] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:20:08 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1408 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:08.922190 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-a4283a9f-abc5-489c-92b4-410991f6fe88 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:08.936284 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-a4283a9f-abc5-489c-92b4-410991f6fe88 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1723 microversion: 2.1 time: 0.317953 May 27 15:20:08.937000 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 372/714] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:08 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1723 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:09.286836 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-1b51beaf-4c7b-434a-a3eb-c06ee4b0f0df tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:09.287462 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-1b51beaf-4c7b-434a-a3eb-c06ee4b0f0df tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:09.289366 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=2 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:09.290070 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=12 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:09.296646 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1b51beaf-4c7b-434a-a3eb-c06ee4b0f0df tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:09.297098 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1b51beaf-4c7b-434a-a3eb-c06ee4b0f0df tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:09.297883 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1b51beaf-4c7b-434a-a3eb-c06ee4b0f0df tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:09.298966 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1b51beaf-4c7b-434a-a3eb-c06ee4b0f0df tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:09.486574 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f53a365e-3152-40c2-8df9-7f643c04044b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:09.487242 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f53a365e-3152-40c2-8df9-7f643c04044b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:09.489688 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=18 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:09.495604 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f53a365e-3152-40c2-8df9-7f643c04044b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:09.496009 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f53a365e-3152-40c2-8df9-7f643c04044b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:09.497048 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f53a365e-3152-40c2-8df9-7f643c04044b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:09.497488 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f53a365e-3152-40c2-8df9-7f643c04044b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:09.566788 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-1b51beaf-4c7b-434a-a3eb-c06ee4b0f0df tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:09.575379 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-1b51beaf-4c7b-434a-a3eb-c06ee4b0f0df tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1576 microversion: 2.1 time: 0.292883 May 27 15:20:09.575879 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 343/715] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:09 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1576 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:09.740504 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f53a365e-3152-40c2-8df9-7f643c04044b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:09.747957 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f53a365e-3152-40c2-8df9-7f643c04044b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1363 microversion: 2.1 time: 0.266097 May 27 15:20:09.748537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 373/716] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:09 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:09.942063 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-4cbf36d6-a24e-40d0-b19b-06db9dcb748f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:09.942898 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-4cbf36d6-a24e-40d0-b19b-06db9dcb748f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:09.949800 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4cbf36d6-a24e-40d0-b19b-06db9dcb748f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:09.950332 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4cbf36d6-a24e-40d0-b19b-06db9dcb748f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:09.951223 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4cbf36d6-a24e-40d0-b19b-06db9dcb748f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:09.951760 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4cbf36d6-a24e-40d0-b19b-06db9dcb748f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:09.954922 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-392db1da-f9af-46cc-b7d3-6cf782059733 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:09.956348 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-392db1da-f9af-46cc-b7d3-6cf782059733 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:09.964077 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-392db1da-f9af-46cc-b7d3-6cf782059733 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:09.964077 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-392db1da-f9af-46cc-b7d3-6cf782059733 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:09.964686 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-392db1da-f9af-46cc-b7d3-6cf782059733 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:09.965117 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-392db1da-f9af-46cc-b7d3-6cf782059733 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:10.169177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-392db1da-f9af-46cc-b7d3-6cf782059733 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:10.181527 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-392db1da-f9af-46cc-b7d3-6cf782059733 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1723 microversion: 2.1 time: 0.230993 May 27 15:20:10.182435 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 374/717] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:09 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:10.190080 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-4cbf36d6-a24e-40d0-b19b-06db9dcb748f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:10.200620 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-4cbf36d6-a24e-40d0-b19b-06db9dcb748f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:10.202670 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-4cbf36d6-a24e-40d0-b19b-06db9dcb748f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:10.203947 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-4cbf36d6-a24e-40d0-b19b-06db9dcb748f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1408 microversion: 2.20 time: 0.266368 May 27 15:20:10.211640 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 344/718] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:20:09 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1408 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:10.594533 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-0c05d9de-c273-4890-93f5-db30ba1eaac5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:10.597456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-0c05d9de-c273-4890-93f5-db30ba1eaac5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:10.606551 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0c05d9de-c273-4890-93f5-db30ba1eaac5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:10.607082 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0c05d9de-c273-4890-93f5-db30ba1eaac5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:10.608036 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0c05d9de-c273-4890-93f5-db30ba1eaac5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:10.608859 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0c05d9de-c273-4890-93f5-db30ba1eaac5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:10.750406 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-0c05d9de-c273-4890-93f5-db30ba1eaac5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:10.758298 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-0c05d9de-c273-4890-93f5-db30ba1eaac5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1576 microversion: 2.1 time: 0.167941 May 27 15:20:10.758942 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 375/719] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:10 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:10.768832 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-3de5c113-8ea6-4e55-bfd1-817cebb570c4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:10.769896 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-3de5c113-8ea6-4e55-bfd1-817cebb570c4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:10.780230 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3de5c113-8ea6-4e55-bfd1-817cebb570c4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:10.780964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3de5c113-8ea6-4e55-bfd1-817cebb570c4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:10.783226 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3de5c113-8ea6-4e55-bfd1-817cebb570c4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:10.784252 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3de5c113-8ea6-4e55-bfd1-817cebb570c4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:11.023387 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-3de5c113-8ea6-4e55-bfd1-817cebb570c4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:11.034229 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-3de5c113-8ea6-4e55-bfd1-817cebb570c4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1363 microversion: 2.1 time: 0.271294 May 27 15:20:11.035385 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 345/720] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:10 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:11.201388 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-2298e7e3-9122-415c-a35b-9b4116b013df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:11.202548 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-2298e7e3-9122-415c-a35b-9b4116b013df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:11.210572 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2298e7e3-9122-415c-a35b-9b4116b013df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:11.211498 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2298e7e3-9122-415c-a35b-9b4116b013df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:11.212460 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2298e7e3-9122-415c-a35b-9b4116b013df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:11.213085 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2298e7e3-9122-415c-a35b-9b4116b013df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:11.224878 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-eddb4b9b-c098-4937-b1e5-820064d31664 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:11.225480 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-eddb4b9b-c098-4937-b1e5-820064d31664 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:11.237967 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-eddb4b9b-c098-4937-b1e5-820064d31664 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:11.238430 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-eddb4b9b-c098-4937-b1e5-820064d31664 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:11.239251 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-eddb4b9b-c098-4937-b1e5-820064d31664 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:11.239691 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-eddb4b9b-c098-4937-b1e5-820064d31664 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:11.535318 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-eddb4b9b-c098-4937-b1e5-820064d31664 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:11.545855 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-eddb4b9b-c098-4937-b1e5-820064d31664 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:11.547406 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-eddb4b9b-c098-4937-b1e5-820064d31664 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:11.548626 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-eddb4b9b-c098-4937-b1e5-820064d31664 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1408 microversion: 2.20 time: 0.327747 May 27 15:20:11.549267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 346/721] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:20:11 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1408 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:20:11.596695 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-2298e7e3-9122-415c-a35b-9b4116b013df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:11.612440 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-2298e7e3-9122-415c-a35b-9b4116b013df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1729 microversion: 2.1 time: 0.414770 May 27 15:20:11.612999 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 376/722] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:11 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1729 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:11.638696 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-bf1e8e89-b8e0-4220-a609-17452660c356 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:11.640939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-bf1e8e89-b8e0-4220-a609-17452660c356 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:11.653968 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bf1e8e89-b8e0-4220-a609-17452660c356 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:11.655198 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bf1e8e89-b8e0-4220-a609-17452660c356 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:11.656737 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bf1e8e89-b8e0-4220-a609-17452660c356 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:11.657739 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bf1e8e89-b8e0-4220-a609-17452660c356 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:11.778575 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-5c28d8f7-f349-4170-ab2e-d396fadfed07 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:11.779838 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-5c28d8f7-f349-4170-ab2e-d396fadfed07 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:11.798104 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5c28d8f7-f349-4170-ab2e-d396fadfed07 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:11.798951 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5c28d8f7-f349-4170-ab2e-d396fadfed07 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:11.801237 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5c28d8f7-f349-4170-ab2e-d396fadfed07 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:11.802050 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5c28d8f7-f349-4170-ab2e-d396fadfed07 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:11.903996 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-bf1e8e89-b8e0-4220-a609-17452660c356 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.270232 May 27 15:20:11.904909 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 347/723] 10.222.0.50 () {58 vars in 1274 bytes} [Fri May 27 15:20:11 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5/os-interface => generated 284 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:20:12.058037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-2169416f-9ce6-4677-8064-596e657d5b1d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:12.059235 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-2169416f-9ce6-4677-8064-596e657d5b1d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:12.076326 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2169416f-9ce6-4677-8064-596e657d5b1d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:12.077696 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2169416f-9ce6-4677-8064-596e657d5b1d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:12.079696 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2169416f-9ce6-4677-8064-596e657d5b1d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:12.080669 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2169416f-9ce6-4677-8064-596e657d5b1d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:12.123382 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5c28d8f7-f349-4170-ab2e-d396fadfed07 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:12.140686 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-5c28d8f7-f349-4170-ab2e-d396fadfed07 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1576 microversion: 2.1 time: 0.366752 May 27 15:20:12.156594 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 377/724] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:11 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1576 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:12.545307 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-2169416f-9ce6-4677-8064-596e657d5b1d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:12.561529 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-2169416f-9ce6-4677-8064-596e657d5b1d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1363 microversion: 2.1 time: 0.511343 May 27 15:20:12.563161 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 348/725] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:12 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1363 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:12.568589 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8548682c-b78e-4cec-aac9-4c25fb245e11 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:12.569874 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-8548682c-b78e-4cec-aac9-4c25fb245e11 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:12.583443 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8548682c-b78e-4cec-aac9-4c25fb245e11 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:12.584106 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8548682c-b78e-4cec-aac9-4c25fb245e11 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:12.585124 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8548682c-b78e-4cec-aac9-4c25fb245e11 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:12.586562 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8548682c-b78e-4cec-aac9-4c25fb245e11 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:12.918936 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-8548682c-b78e-4cec-aac9-4c25fb245e11 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:12.930968 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-8548682c-b78e-4cec-aac9-4c25fb245e11 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:12.933216 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-8548682c-b78e-4cec-aac9-4c25fb245e11 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:12.934793 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-8548682c-b78e-4cec-aac9-4c25fb245e11 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1408 microversion: 2.20 time: 0.371057 May 27 15:20:12.935673 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 378/726] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:20:12 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1408 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:20:13.169693 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-5e46ceef-7845-43b1-9648-f1e02c5f8fe6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:13.171231 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-5e46ceef-7845-43b1-9648-f1e02c5f8fe6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:13.186830 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5e46ceef-7845-43b1-9648-f1e02c5f8fe6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:13.187911 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5e46ceef-7845-43b1-9648-f1e02c5f8fe6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:13.189727 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5e46ceef-7845-43b1-9648-f1e02c5f8fe6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:13.190605 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5e46ceef-7845-43b1-9648-f1e02c5f8fe6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:13.564940 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-5e46ceef-7845-43b1-9648-f1e02c5f8fe6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:13.573050 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-5e46ceef-7845-43b1-9648-f1e02c5f8fe6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1508 microversion: 2.1 time: 0.411712 May 27 15:20:13.573637 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 349/727] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:13 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1508 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:13.586412 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-88ec302c-7d6a-45bf-8ce6-2326ff0b8e9d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:13.587181 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-88ec302c-7d6a-45bf-8ce6-2326ff0b8e9d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:13.600130 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-88ec302c-7d6a-45bf-8ce6-2326ff0b8e9d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:13.601584 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-88ec302c-7d6a-45bf-8ce6-2326ff0b8e9d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:13.603772 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-88ec302c-7d6a-45bf-8ce6-2326ff0b8e9d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:13.604482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-88ec302c-7d6a-45bf-8ce6-2326ff0b8e9d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:13.628770 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-e79007af-18e7-4912-b0ee-39cb1012b03e req-a4bfe6af-c864-4723-ad62-b73dffc2342c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b91f595-1d49-4eed-8d8c-57bb287d34b5", "tag": "912582f8-c57d-4774-8d6c-0a14883de730"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:13.647294 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-e79007af-18e7-4912-b0ee-39cb1012b03e req-a4bfe6af-c864-4723-ad62-b73dffc2342c service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:13.648189 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-e79007af-18e7-4912-b0ee-39cb1012b03e req-a4bfe6af-c864-4723-ad62-b73dffc2342c service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:13.678119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-e79007af-18e7-4912-b0ee-39cb1012b03e req-a4bfe6af-c864-4723-ad62-b73dffc2342c service nova] Creating event network-changed:912582f8-c57d-4774-8d6c-0a14883de730 for instance 5b91f595-1d49-4eed-8d8c-57bb287d34b5 on hv-cinder-84254 May 27 15:20:13.699609 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-e79007af-18e7-4912-b0ee-39cb1012b03e req-a4bfe6af-c864-4723-ad62-b73dffc2342c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077030 May 27 15:20:13.705132 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 350/728] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:20:13.955290 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-ac609e0d-3417-43f4-b99d-3783105074c9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:13.956105 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-ac609e0d-3417-43f4-b99d-3783105074c9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:13.962658 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ac609e0d-3417-43f4-b99d-3783105074c9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:13.964196 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ac609e0d-3417-43f4-b99d-3783105074c9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:13.964196 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ac609e0d-3417-43f4-b99d-3783105074c9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:13.964512 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ac609e0d-3417-43f4-b99d-3783105074c9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:13.966193 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-88ec302c-7d6a-45bf-8ce6-2326ff0b8e9d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:14.002069 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-88ec302c-7d6a-45bf-8ce6-2326ff0b8e9d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1363 microversion: 2.1 time: 0.414251 May 27 15:20:14.019235 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 379/729] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:13 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1363 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:14.329732 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-ac609e0d-3417-43f4-b99d-3783105074c9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:14.340378 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-ac609e0d-3417-43f4-b99d-3783105074c9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:14.345301 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-ac609e0d-3417-43f4-b99d-3783105074c9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:14.352098 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-ac609e0d-3417-43f4-b99d-3783105074c9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1408 microversion: 2.20 time: 0.400705 May 27 15:20:14.353863 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 351/730] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:20:13 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1408 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:20:14.475932 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-2eb93a46-c802-4355-a57a-f8ad79262d21 req-0685bd07-f04f-4e6b-be61-aa8bdd570f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b00f36f-8f62-43f7-bdeb-71c22904dd0a", "name": "network-vif-deleted", "tag": "3b5cfd14-7448-43de-994e-2bf2d7ae2d0b"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:14.490234 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-2eb93a46-c802-4355-a57a-f8ad79262d21 req-0685bd07-f04f-4e6b-be61-aa8bdd570f1f service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:14.490682 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-2eb93a46-c802-4355-a57a-f8ad79262d21 req-0685bd07-f04f-4e6b-be61-aa8bdd570f1f service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:14.506741 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-2eb93a46-c802-4355-a57a-f8ad79262d21 req-0685bd07-f04f-4e6b-be61-aa8bdd570f1f service nova] Creating event network-vif-deleted:3b5cfd14-7448-43de-994e-2bf2d7ae2d0b for instance 0b00f36f-8f62-43f7-bdeb-71c22904dd0a on hv-cinder-84254 May 27 15:20:14.519994 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-2eb93a46-c802-4355-a57a-f8ad79262d21 req-0685bd07-f04f-4e6b-be61-aa8bdd570f1f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.431654 May 27 15:20:14.521237 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 380/731] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:14.600815 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-73c0f9ae-5e96-4a0d-b109-4125011806e8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:14.603105 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-73c0f9ae-5e96-4a0d-b109-4125011806e8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:14.616588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-73c0f9ae-5e96-4a0d-b109-4125011806e8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:14.617439 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-73c0f9ae-5e96-4a0d-b109-4125011806e8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:14.618557 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-73c0f9ae-5e96-4a0d-b109-4125011806e8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:14.619302 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-73c0f9ae-5e96-4a0d-b109-4125011806e8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:14.669825 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-73c0f9ae-5e96-4a0d-b109-4125011806e8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:14.670805 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-73c0f9ae-5e96-4a0d-b109-4125011806e8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:14.671596 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.objects.instance [None req-73c0f9ae-5e96-4a0d-b109-4125011806e8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lazy-loading 'fault' on Instance uuid 0b00f36f-8f62-43f7-bdeb-71c22904dd0a {{(pid=117743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:14.749270 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-73c0f9ae-5e96-4a0d-b109-4125011806e8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:14.760875 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-73c0f9ae-5e96-4a0d-b109-4125011806e8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 200 len: 1230 microversion: 2.1 time: 0.164718 May 27 15:20:14.762129 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 352/732] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:14 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 1230 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:15.021297 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-eee0679b-b8c4-4114-a6ac-749f636a13c4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:15.023251 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-eee0679b-b8c4-4114-a6ac-749f636a13c4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:15.029857 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-eee0679b-b8c4-4114-a6ac-749f636a13c4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:15.031282 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-eee0679b-b8c4-4114-a6ac-749f636a13c4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:15.038972 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-eee0679b-b8c4-4114-a6ac-749f636a13c4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:15.039534 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-eee0679b-b8c4-4114-a6ac-749f636a13c4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:15.234893 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-eee0679b-b8c4-4114-a6ac-749f636a13c4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:15.247438 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-eee0679b-b8c4-4114-a6ac-749f636a13c4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1363 microversion: 2.1 time: 0.231647 May 27 15:20:15.260863 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 381/733] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:15 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:15.372027 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-ce61172b-f593-411d-bb95-0741af13df13 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:15.374325 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-ce61172b-f593-411d-bb95-0741af13df13 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:15.382364 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ce61172b-f593-411d-bb95-0741af13df13 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:15.383186 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ce61172b-f593-411d-bb95-0741af13df13 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:15.384242 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ce61172b-f593-411d-bb95-0741af13df13 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:15.384721 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ce61172b-f593-411d-bb95-0741af13df13 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:15.468312 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8d2c7aa1-b340-42e3-8894-d2d560418d5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:15.469320 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-8d2c7aa1-b340-42e3-8894-d2d560418d5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:15.485028 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8d2c7aa1-b340-42e3-8894-d2d560418d5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:15.486104 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8d2c7aa1-b340-42e3-8894-d2d560418d5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:15.486945 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8d2c7aa1-b340-42e3-8894-d2d560418d5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:15.487397 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8d2c7aa1-b340-42e3-8894-d2d560418d5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:15.588048 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-ce61172b-f593-411d-bb95-0741af13df13 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:15.598308 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-ce61172b-f593-411d-bb95-0741af13df13 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:15.600084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-ce61172b-f593-411d-bb95-0741af13df13 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:15.601710 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-ce61172b-f593-411d-bb95-0741af13df13 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1600 microversion: 2.20 time: 0.234838 May 27 15:20:15.621449 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.objects.instance [None req-8d2c7aa1-b340-42e3-8894-d2d560418d5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lazy-loading 'services' on Instance uuid 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 {{(pid=117742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:15.621942 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 353/734] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:20:15 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1600 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:20:15.632752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-08d43290-ed58-49a4-836a-2cf6a3de6c9a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:15.633429 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-08d43290-ed58-49a4-836a-2cf6a3de6c9a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:15.640523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-08d43290-ed58-49a4-836a-2cf6a3de6c9a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:15.641691 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-08d43290-ed58-49a4-836a-2cf6a3de6c9a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:15.643007 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-08d43290-ed58-49a4-836a-2cf6a3de6c9a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:15.643761 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-08d43290-ed58-49a4-836a-2cf6a3de6c9a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:15.723888 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-8d2c7aa1-b340-42e3-8894-d2d560418d5c tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1/os-volume_attachments/946af515-90b3-465b-a1e1-4c712a18c03d" status: 202 len: 0 microversion: 2.1 time: 0.261368 May 27 15:20:15.724683 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 382/735] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 15:20:15 2022] DELETE /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1/os-volume_attachments/946af515-90b3-465b-a1e1-4c712a18c03d => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:20:15.731798 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-b045641d-5f82-4e4a-a19e-1544aefb82a5 req-b5bfad12-8da8-4263-bee4-a32db9f0d9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b91f595-1d49-4eed-8d8c-57bb287d34b5", "tag": "912582f8-c57d-4774-8d6c-0a14883de730"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:15.745815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-b045641d-5f82-4e4a-a19e-1544aefb82a5 req-b5bfad12-8da8-4263-bee4-a32db9f0d9f7 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:15.746737 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-b045641d-5f82-4e4a-a19e-1544aefb82a5 req-b5bfad12-8da8-4263-bee4-a32db9f0d9f7 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:15.765082 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-08d43290-ed58-49a4-836a-2cf6a3de6c9a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.141973 May 27 15:20:15.765804 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 354/736] 10.222.0.50 () {60 vars in 1315 bytes} [Fri May 27 15:20:15 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe/os-interface => generated 285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:20:15.775452 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-b045641d-5f82-4e4a-a19e-1544aefb82a5 req-b5bfad12-8da8-4263-bee4-a32db9f0d9f7 service nova] Creating event network-changed:912582f8-c57d-4774-8d6c-0a14883de730 for instance 5b91f595-1d49-4eed-8d8c-57bb287d34b5 on hv-cinder-84254 May 27 15:20:15.779720 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-29b62ed1-016d-4ba4-8a01-31343414056f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:15.780679 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-29b62ed1-016d-4ba4-8a01-31343414056f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:15.792861 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-29b62ed1-016d-4ba4-8a01-31343414056f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:15.797232 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-b045641d-5f82-4e4a-a19e-1544aefb82a5 req-b5bfad12-8da8-4263-bee4-a32db9f0d9f7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070309 May 27 15:20:15.798306 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-29b62ed1-016d-4ba4-8a01-31343414056f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:15.798428 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 383/737] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:15.799975 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-29b62ed1-016d-4ba4-8a01-31343414056f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:15.802893 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-29b62ed1-016d-4ba4-8a01-31343414056f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:15.828644 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-29b62ed1-016d-4ba4-8a01-31343414056f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] HTTP exception thrown: Instance 0b00f36f-8f62-43f7-bdeb-71c22904dd0a could not be found. May 27 15:20:15.832353 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-29b62ed1-016d-4ba4-8a01-31343414056f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Request method failure captured: May 27 15:20:15.832353 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a HTTP/1.1 May 27 15:20:15.832353 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:20:15.832353 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:20:15.832353 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:20:15.832353 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 0 May 27 15:20:15.832353 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:20:15.832353 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:20:15.832353 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:20:15.832353 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:20:15.832353 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOtKZtXzbtQq-mzRl_VucDX3JU2QZa0XFpKq1w0KZsmc8vHDP47vFW9o-cpdTV2XgVEmnZ2ELAeJmUo9SgWsSCNtvd2INJL0jeoi_VloSf945zMe90YQAg2IKM9mZrXPdblMPFwj-yqV843Kd81q3M0zyP0qopiCS0_yG3grfqi5ohU May 27 15:20:15.832353 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:20:15.832353 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:20:15.832353 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:20:15.832353 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:20:15.832353 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:20:15.832353 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:20:15.832353 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: f88bb4c8b75c4ad6be62f2cf5cf509c4 May 27 15:20:15.832353 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-TestVolumeBootPattern-1063732983 May 27 15:20:15.832353 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:20:15.832353 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:20:15.833734 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f88bb4c8b75c4ad6be62f2cf5cf509c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f88bb4c8b75c4ad6be62f2cf5cf509c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f88bb4c8b75c4ad6be62f2cf5cf509c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f88bb4c8b75c4ad6be62f2cf5cf509c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:20:15.833734 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-TestVolumeBootPattern-1063732983 May 27 15:20:15.833734 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: f88bb4c8b75c4ad6be62f2cf5cf509c4 May 27 15:20:15.833734 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-TestVolumeBootPattern-1063732983 May 27 15:20:15.833734 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-TestVolumeBootPattern-1063732983-project May 27 15:20:15.833734 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:20:15.833734 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:20:15.833734 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: af74115f423c43fdb2544876be4e5622 May 27 15:20:15.833734 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-TestVolumeBootPattern-1063732983-project May 27 15:20:15.833734 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: > May 27 15:20:15.833734 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Instance 0b00f36f-8f62-43f7-bdeb-71c22904dd0a could not be found. May 27 15:20:15.833734 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'id': '0b00f36f-8f62-43f7-bdeb-71c22904dd0a'} May 27 15:20:15.834772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:20:15.834772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:15.834772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:20:15.834772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:20:15.834772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:20:15.834772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:20:15.834772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:20:15.834772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:20:15.834772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:20:15.834772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:20:15.834772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b00f36f-8f62-43f7-bdeb-71c22904dd0a could not be found. May 27 15:20:15.834772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:15.834772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:15.834772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:15.834772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:15.834772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:15.834772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:15.834772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:20:15.834772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:20:15.834772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:20:15.837597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:20:15.837597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:20:15.837597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:20:15.837597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:20:15.837597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:20:15.837597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:20:15.837597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:20:15.837597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b00f36f-8f62-43f7-bdeb-71c22904dd0a could not be found. May 27 15:20:15.837597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:15.837597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:15.837597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:15.837597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:15.837597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:15.837597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:15.837597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:20:15.837597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:20:15.837597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b00f36f-8f62-43f7-bdeb-71c22904dd0a could not be found. May 27 15:20:15.837597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:15.839358 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-29b62ed1-016d-4ba4-8a01-31343414056f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Returning 404 to user: Instance 0b00f36f-8f62-43f7-bdeb-71c22904dd0a could not be found. {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:20:15.839358 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-29b62ed1-016d-4ba4-8a01-31343414056f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 404 len: 111 microversion: 2.1 time: 0.058937 May 27 15:20:15.839358 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 355/738] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:15 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:20:15.978769 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-09a741a7-1bbe-43df-94de-5f5e5262010f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1800085441", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-504926628", "security_groups": [{"name": "tempest-secgroup-smoke-1034671319"}], "block_device_mapping_v2": [{"uuid": "e4cdc785-4e11-4673-995f-75ea313d05ab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2342e702-bd4d-4c84-b0ae-7b5944b1b9c3"}]}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:16.101553 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.network.neutron [None req-09a741a7-1bbe-43df-94de-5f5e5262010f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] validate_networks() for [('2342e702-bd4d-4c84-b0ae-7b5944b1b9c3', None, None, None, None, None)] {{(pid=117742) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:20:16.268192 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-28dfb965-b94f-4701-ade8-82f68ca93e09 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:16.269314 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-28dfb965-b94f-4701-ade8-82f68ca93e09 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:16.279053 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-28dfb965-b94f-4701-ade8-82f68ca93e09 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:16.279690 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-28dfb965-b94f-4701-ade8-82f68ca93e09 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:16.280730 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-28dfb965-b94f-4701-ade8-82f68ca93e09 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:16.281679 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-28dfb965-b94f-4701-ade8-82f68ca93e09 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:16.537181 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-28dfb965-b94f-4701-ade8-82f68ca93e09 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:16.549866 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-28dfb965-b94f-4701-ade8-82f68ca93e09 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1363 microversion: 2.1 time: 0.286997 May 27 15:20:16.551162 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 356/739] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:16 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:16.601740 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-09a741a7-1bbe-43df-94de-5f5e5262010f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Flavor limits 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:20:16.602235 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-09a741a7-1bbe-43df-94de-5f5e5262010f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Image limits 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:20:16.602783 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-09a741a7-1bbe-43df-94de-5f5e5262010f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Flavor pref 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:20:16.603302 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-09a741a7-1bbe-43df-94de-5f5e5262010f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Image pref 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:20:16.603786 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-09a741a7-1bbe-43df-94de-5f5e5262010f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:20:16.613701 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-09a741a7-1bbe-43df-94de-5f5e5262010f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:16.614236 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-09a741a7-1bbe-43df-94de-5f5e5262010f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:16.615241 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-09a741a7-1bbe-43df-94de-5f5e5262010f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:16.615746 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-09a741a7-1bbe-43df-94de-5f5e5262010f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:16.633685 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-09a741a7-1bbe-43df-94de-5f5e5262010f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Getting quotas for project f88bb4c8b75c4ad6be62f2cf5cf509c4. Resources: {'cores', 'ram', 'instances'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:20:16.637950 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-09a741a7-1bbe-43df-94de-5f5e5262010f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Getting quotas for user af74115f423c43fdb2544876be4e5622 and project f88bb4c8b75c4ad6be62f2cf5cf509c4. Resources: {'cores', 'ram', 'instances'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:20:16.702306 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-09a741a7-1bbe-43df-94de-5f5e5262010f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Going to run 1 instances... {{(pid=117742) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:20:16.704580 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-09a741a7-1bbe-43df-94de-5f5e5262010f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e4cdc785-4e11-4673-995f-75ea313d05ab',volume_size=None,volume_type=None)] {{(pid=117742) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:20:16.891175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-09a741a7-1bbe-43df-94de-5f5e5262010f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.918469 May 27 15:20:16.892851 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 384/740] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 15:20:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:20:16.905758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b665228e-f91e-45c3-9b37-45d34398c071 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:16.906895 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b665228e-f91e-45c3-9b37-45d34398c071 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:17.048875 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b665228e-f91e-45c3-9b37-45d34398c071 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:17.071267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b665228e-f91e-45c3-9b37-45d34398c071 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1094 microversion: 2.1 time: 0.171316 May 27 15:20:17.072315 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 357/741] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:16 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1094 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:17.568284 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-49f66ac2-3c26-4274-a03b-bd549d1b5b80 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:17.568911 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-49f66ac2-3c26-4274-a03b-bd549d1b5b80 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:17.576791 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-49f66ac2-3c26-4274-a03b-bd549d1b5b80 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:17.577569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-49f66ac2-3c26-4274-a03b-bd549d1b5b80 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:17.578560 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-49f66ac2-3c26-4274-a03b-bd549d1b5b80 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:17.579650 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-49f66ac2-3c26-4274-a03b-bd549d1b5b80 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:17.791730 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-49f66ac2-3c26-4274-a03b-bd549d1b5b80 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:17.809397 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-49f66ac2-3c26-4274-a03b-bd549d1b5b80 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1363 microversion: 2.1 time: 0.244958 May 27 15:20:17.810514 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 385/742] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:17 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:17.996180 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-c5a4e305-5cd4-4a16-9809-a3e36439eb22 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:17.997245 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-c5a4e305-5cd4-4a16-9809-a3e36439eb22 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:18.007672 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c5a4e305-5cd4-4a16-9809-a3e36439eb22 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:18.008891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c5a4e305-5cd4-4a16-9809-a3e36439eb22 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:18.010294 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c5a4e305-5cd4-4a16-9809-a3e36439eb22 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:18.012025 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c5a4e305-5cd4-4a16-9809-a3e36439eb22 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:18.044569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-c5a4e305-5cd4-4a16-9809-a3e36439eb22 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Going to try to terminate instance {{(pid=117742) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:20:18.111102 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:18.124567 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-c11e2910-a15f-4864-84ca-dc07f67c98ea req-f2a5b376-d38d-44ad-9014-095c7ce4dc1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1c52039-f595-4f22-9df9-ea3a999f55fe", "tag": "00ae88d7-8fbc-40d5-aefb-819837b95c30"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:18.138155 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-c11e2910-a15f-4864-84ca-dc07f67c98ea req-f2a5b376-d38d-44ad-9014-095c7ce4dc1d service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:18.139048 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-c11e2910-a15f-4864-84ca-dc07f67c98ea req-f2a5b376-d38d-44ad-9014-095c7ce4dc1d service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:18.152255 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-c5a4e305-5cd4-4a16-9809-a3e36439eb22 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1" status: 204 len: 0 microversion: 2.1 time: 0.166617 May 27 15:20:18.152255 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 386/743] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:20:17 2022] DELETE /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:20:18.156632 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b6cee4bd-49b6-45e8-969f-b6ef3394366d tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:18.158032 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b6cee4bd-49b6-45e8-969f-b6ef3394366d tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:18.165135 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b6cee4bd-49b6-45e8-969f-b6ef3394366d tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:18.165871 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b6cee4bd-49b6-45e8-969f-b6ef3394366d tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:18.166669 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b6cee4bd-49b6-45e8-969f-b6ef3394366d tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:18.167237 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b6cee4bd-49b6-45e8-969f-b6ef3394366d tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:18.167871 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-c11e2910-a15f-4864-84ca-dc07f67c98ea req-f2a5b376-d38d-44ad-9014-095c7ce4dc1d service nova] Creating event network-changed:00ae88d7-8fbc-40d5-aefb-819837b95c30 for instance f1c52039-f595-4f22-9df9-ea3a999f55fe on hv-cinder-84254 May 27 15:20:18.173621 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-c11e2910-a15f-4864-84ca-dc07f67c98ea req-f2a5b376-d38d-44ad-9014-095c7ce4dc1d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.315157 May 27 15:20:18.174584 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 358/744] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:18.181071 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-5098853d-2d4f-497c-89b3-59f26b4f3492 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:18.181786 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-5098853d-2d4f-497c-89b3-59f26b4f3492 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:18.188249 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5098853d-2d4f-497c-89b3-59f26b4f3492 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:18.188924 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5098853d-2d4f-497c-89b3-59f26b4f3492 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:18.189914 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5098853d-2d4f-497c-89b3-59f26b4f3492 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:18.190357 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5098853d-2d4f-497c-89b3-59f26b4f3492 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:18.257957 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b6cee4bd-49b6-45e8-969f-b6ef3394366d tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:18.267125 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b6cee4bd-49b6-45e8-969f-b6ef3394366d tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1192 microversion: 2.1 time: 0.114796 May 27 15:20:18.267898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 387/745] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:18 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1192 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:18.377113 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-5098853d-2d4f-497c-89b3-59f26b4f3492 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:18.385302 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-5098853d-2d4f-497c-89b3-59f26b4f3492 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1" status: 200 len: 1513 microversion: 2.1 time: 0.209225 May 27 15:20:18.385892 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 359/746] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:18 2022] GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 => generated 1513 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:18.838564 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-5a58d9b6-8234-4310-9eb0-1d15e6764c8a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:18.839197 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-5a58d9b6-8234-4310-9eb0-1d15e6764c8a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:18.846285 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5a58d9b6-8234-4310-9eb0-1d15e6764c8a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:18.846554 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5a58d9b6-8234-4310-9eb0-1d15e6764c8a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:18.847377 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5a58d9b6-8234-4310-9eb0-1d15e6764c8a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:18.847805 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5a58d9b6-8234-4310-9eb0-1d15e6764c8a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:18.997261 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5a58d9b6-8234-4310-9eb0-1d15e6764c8a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:19.007509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-5a58d9b6-8234-4310-9eb0-1d15e6764c8a tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1363 microversion: 2.1 time: 0.173111 May 27 15:20:19.008102 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 388/747] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:18 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:19.285732 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-e455ad46-981a-4714-a056-a192cdd6d9e2 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:19.286374 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-e455ad46-981a-4714-a056-a192cdd6d9e2 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:19.293292 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e455ad46-981a-4714-a056-a192cdd6d9e2 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:19.293747 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e455ad46-981a-4714-a056-a192cdd6d9e2 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:19.294537 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e455ad46-981a-4714-a056-a192cdd6d9e2 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:19.295016 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-e455ad46-981a-4714-a056-a192cdd6d9e2 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:19.360438 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-e455ad46-981a-4714-a056-a192cdd6d9e2 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:19.368566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-e455ad46-981a-4714-a056-a192cdd6d9e2 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1200 microversion: 2.1 time: 0.087445 May 27 15:20:19.369163 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 360/748] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:19 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1200 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:19.405392 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-89a91225-e341-431e-b9f2-96e826fc48d0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:19.405922 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-89a91225-e341-431e-b9f2-96e826fc48d0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:19.412822 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-89a91225-e341-431e-b9f2-96e826fc48d0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:19.413269 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-89a91225-e341-431e-b9f2-96e826fc48d0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:19.414079 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-89a91225-e341-431e-b9f2-96e826fc48d0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:19.414497 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-89a91225-e341-431e-b9f2-96e826fc48d0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:19.570969 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-89a91225-e341-431e-b9f2-96e826fc48d0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:19.579630 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-89a91225-e341-431e-b9f2-96e826fc48d0 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1" status: 200 len: 1513 microversion: 2.1 time: 0.177626 May 27 15:20:19.580446 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 389/749] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:19 2022] GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:20.024807 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-abbe687c-37fa-4059-832c-3e4e5266f5a4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:20.025418 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-abbe687c-37fa-4059-832c-3e4e5266f5a4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:20.031918 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-abbe687c-37fa-4059-832c-3e4e5266f5a4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:20.032480 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-abbe687c-37fa-4059-832c-3e4e5266f5a4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:20.033164 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-abbe687c-37fa-4059-832c-3e4e5266f5a4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:20.033597 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-abbe687c-37fa-4059-832c-3e4e5266f5a4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:20.207325 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-abbe687c-37fa-4059-832c-3e4e5266f5a4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:20.215173 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-abbe687c-37fa-4059-832c-3e4e5266f5a4 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1363 microversion: 2.1 time: 0.194248 May 27 15:20:20.215775 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 361/750] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:20 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:20.385736 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-99ba9d1b-288f-4ae6-bf63-1016d2a4486f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:20.386377 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-99ba9d1b-288f-4ae6-bf63-1016d2a4486f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:20.394396 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-99ba9d1b-288f-4ae6-bf63-1016d2a4486f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:20.394872 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-99ba9d1b-288f-4ae6-bf63-1016d2a4486f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:20.395706 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-99ba9d1b-288f-4ae6-bf63-1016d2a4486f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:20.396146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-99ba9d1b-288f-4ae6-bf63-1016d2a4486f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:20.480280 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-99ba9d1b-288f-4ae6-bf63-1016d2a4486f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:20.495634 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-99ba9d1b-288f-4ae6-bf63-1016d2a4486f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1210 microversion: 2.1 time: 0.113041 May 27 15:20:20.501796 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 390/751] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:20 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1210 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:20.599088 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-2f78004f-fade-4597-bc3a-6c081efab3b1 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:20.600451 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-2f78004f-fade-4597-bc3a-6c081efab3b1 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:20.607127 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2f78004f-fade-4597-bc3a-6c081efab3b1 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:20.607945 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2f78004f-fade-4597-bc3a-6c081efab3b1 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:20.609025 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2f78004f-fade-4597-bc3a-6c081efab3b1 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:20.609680 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2f78004f-fade-4597-bc3a-6c081efab3b1 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:20.616045 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=100 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:20.850015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-2f78004f-fade-4597-bc3a-6c081efab3b1 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:20.865316 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-2f78004f-fade-4597-bc3a-6c081efab3b1 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1" status: 200 len: 1513 microversion: 2.1 time: 0.270995 May 27 15:20:20.881797 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 362/752] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:20 2022] GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 => generated 1513 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:21.020184 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-7ab4f189-6dc8-497a-b663-d753151ba3d9 req-5f822cb2-eae2-46b7-bdb1-0c061eb8005e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4a7119-2de1-4f92-a310-bdd2eb2aa316", "name": "network-vif-plugged", "status": "completed", "tag": "37e04985-41a3-46a7-bd4a-0d11189b7fbf"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:21.030763 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-7ab4f189-6dc8-497a-b663-d753151ba3d9 req-5f822cb2-eae2-46b7-bdb1-0c061eb8005e service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:21.031426 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-7ab4f189-6dc8-497a-b663-d753151ba3d9 req-5f822cb2-eae2-46b7-bdb1-0c061eb8005e service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:21.050112 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-7ab4f189-6dc8-497a-b663-d753151ba3d9 req-5f822cb2-eae2-46b7-bdb1-0c061eb8005e service nova] Creating event network-vif-plugged:37e04985-41a3-46a7-bd4a-0d11189b7fbf for instance fe4a7119-2de1-4f92-a310-bdd2eb2aa316 on hv-cinder-84254 May 27 15:20:21.057366 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-7ab4f189-6dc8-497a-b663-d753151ba3d9 req-5f822cb2-eae2-46b7-bdb1-0c061eb8005e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122250 May 27 15:20:21.058273 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 391/753] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:21.192174 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-a461b151-1761-468b-b3c1-c052720318aa req-bb763bb0-1e94-4d5b-adb6-71cb8765c8b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1", "name": "network-vif-deleted", "tag": "43619b86-23d3-4ddb-85d5-c69b05a310f0"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:21.201477 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-a461b151-1761-468b-b3c1-c052720318aa req-bb763bb0-1e94-4d5b-adb6-71cb8765c8b2 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:21.201915 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-a461b151-1761-468b-b3c1-c052720318aa req-bb763bb0-1e94-4d5b-adb6-71cb8765c8b2 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:21.217632 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-a461b151-1761-468b-b3c1-c052720318aa req-bb763bb0-1e94-4d5b-adb6-71cb8765c8b2 service nova] Creating event network-vif-deleted:43619b86-23d3-4ddb-85d5-c69b05a310f0 for instance 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 on hv-cinder-84254 May 27 15:20:21.226739 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-a461b151-1761-468b-b3c1-c052720318aa req-bb763bb0-1e94-4d5b-adb6-71cb8765c8b2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037287 May 27 15:20:21.227586 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 363/754] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:20:21.237915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-7e49304b-c79b-4163-8378-ce2a6cb99316 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:21.238763 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-7e49304b-c79b-4163-8378-ce2a6cb99316 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:21.254635 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7e49304b-c79b-4163-8378-ce2a6cb99316 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:21.255115 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7e49304b-c79b-4163-8378-ce2a6cb99316 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:21.256122 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7e49304b-c79b-4163-8378-ce2a6cb99316 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:21.256562 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7e49304b-c79b-4163-8378-ce2a6cb99316 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:21.512514 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-7e49304b-c79b-4163-8378-ce2a6cb99316 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:21.522338 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-32c94480-a20c-4338-9179-6e71f3790a93 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:21.523175 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-32c94480-a20c-4338-9179-6e71f3790a93 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:21.526297 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-7e49304b-c79b-4163-8378-ce2a6cb99316 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1363 microversion: 2.1 time: 0.294502 May 27 15:20:21.527987 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 392/755] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:21 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1363 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:21.530423 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-32c94480-a20c-4338-9179-6e71f3790a93 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:21.531026 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-32c94480-a20c-4338-9179-6e71f3790a93 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:21.532130 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-32c94480-a20c-4338-9179-6e71f3790a93 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:21.532683 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-32c94480-a20c-4338-9179-6e71f3790a93 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:21.628260 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-32c94480-a20c-4338-9179-6e71f3790a93 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:21.638580 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-32c94480-a20c-4338-9179-6e71f3790a93 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1198 microversion: 2.1 time: 0.120594 May 27 15:20:21.639361 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 364/756] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:21 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1198 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:21.896233 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-c3b241b1-ece2-4546-bb16-2fd40074538b tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:21.897029 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-c3b241b1-ece2-4546-bb16-2fd40074538b tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:21.908356 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c3b241b1-ece2-4546-bb16-2fd40074538b tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:21.908810 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c3b241b1-ece2-4546-bb16-2fd40074538b tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:21.910474 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c3b241b1-ece2-4546-bb16-2fd40074538b tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:21.910953 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c3b241b1-ece2-4546-bb16-2fd40074538b tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:21.967749 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c3b241b1-ece2-4546-bb16-2fd40074538b tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:21.968160 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c3b241b1-ece2-4546-bb16-2fd40074538b tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:21.970036 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.objects.instance [None req-c3b241b1-ece2-4546-bb16-2fd40074538b tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lazy-loading 'fault' on Instance uuid 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 {{(pid=117742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:22.041344 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-c3b241b1-ece2-4546-bb16-2fd40074538b tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b257d6c8a034981be9b54789c313d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58318fdd40dd469099dade09793f6b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:22.052134 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-c3b241b1-ece2-4546-bb16-2fd40074538b tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1" status: 200 len: 1309 microversion: 2.1 time: 0.161229 May 27 15:20:22.052720 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 393/757] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:21 2022] GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 => generated 1309 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:22.545811 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-6ecf8c5e-9a91-40ed-ad8d-31174b2f2980 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:22.546426 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-6ecf8c5e-9a91-40ed-ad8d-31174b2f2980 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:22.554094 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6ecf8c5e-9a91-40ed-ad8d-31174b2f2980 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:22.554575 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6ecf8c5e-9a91-40ed-ad8d-31174b2f2980 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:22.555912 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6ecf8c5e-9a91-40ed-ad8d-31174b2f2980 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:22.556359 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6ecf8c5e-9a91-40ed-ad8d-31174b2f2980 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:22.663060 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b8f594b9-cdea-49f2-81bb-5d30766b6504 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:22.664013 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b8f594b9-cdea-49f2-81bb-5d30766b6504 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:22.675233 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b8f594b9-cdea-49f2-81bb-5d30766b6504 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:22.676944 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b8f594b9-cdea-49f2-81bb-5d30766b6504 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:22.678436 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b8f594b9-cdea-49f2-81bb-5d30766b6504 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:22.679548 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b8f594b9-cdea-49f2-81bb-5d30766b6504 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:22.808451 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-6ecf8c5e-9a91-40ed-ad8d-31174b2f2980 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:22.818037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-6ecf8c5e-9a91-40ed-ad8d-31174b2f2980 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1363 microversion: 2.1 time: 0.275984 May 27 15:20:22.818988 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 365/758] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:22 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:22.824425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-91f63791-287c-44af-9b6a-439e63ea87ce req-e89fe5b7-e586-4e5e-815e-335647800bff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57293bbe-cb31-4f35-b133-3b8e673465cb", "tag": "9612e155-cd8f-4e21-816c-b8322b4a154e"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:22.834610 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-91f63791-287c-44af-9b6a-439e63ea87ce req-e89fe5b7-e586-4e5e-815e-335647800bff service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:22.835106 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-91f63791-287c-44af-9b6a-439e63ea87ce req-e89fe5b7-e586-4e5e-815e-335647800bff service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:22.849223 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-91f63791-287c-44af-9b6a-439e63ea87ce req-e89fe5b7-e586-4e5e-815e-335647800bff service nova] Creating event network-changed:9612e155-cd8f-4e21-816c-b8322b4a154e for instance 57293bbe-cb31-4f35-b133-3b8e673465cb on hv-cinder-84254 May 27 15:20:22.854613 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-91f63791-287c-44af-9b6a-439e63ea87ce req-e89fe5b7-e586-4e5e-815e-335647800bff service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034377 May 27 15:20:22.855800 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 366/759] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:22.945136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b8f594b9-cdea-49f2-81bb-5d30766b6504 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:22.955096 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b8f594b9-cdea-49f2-81bb-5d30766b6504 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1266 microversion: 2.1 time: 0.298763 May 27 15:20:22.955730 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 394/760] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:22 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:23.071946 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9227d2fe-74fc-47f5-aabb-da71b3f8f141 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:23.072690 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9227d2fe-74fc-47f5-aabb-da71b3f8f141 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] [instance: 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:23.080673 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9227d2fe-74fc-47f5-aabb-da71b3f8f141 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:23.081391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9227d2fe-74fc-47f5-aabb-da71b3f8f141 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:23.082403 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9227d2fe-74fc-47f5-aabb-da71b3f8f141 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:23.083034 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9227d2fe-74fc-47f5-aabb-da71b3f8f141 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:23.104374 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-9227d2fe-74fc-47f5-aabb-da71b3f8f141 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] HTTP exception thrown: Instance 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 could not be found. May 27 15:20:23.106408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9227d2fe-74fc-47f5-aabb-da71b3f8f141 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Request method failure captured: May 27 15:20:23.106408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 HTTP/1.1 May 27 15:20:23.106408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:20:23.106408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:20:23.106408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:20:23.106408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 0 May 27 15:20:23.106408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:20:23.106408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:20:23.106408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:20:23.106408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:20:23.106408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOu3ZzeJ25CqdOGd2HjdU-YqaOYartue1RUykxBNRS12xMLIGGmp4Ugi1Ly1tUKHPyGAR5rwN2lE7cKGIFk6ECr8rgNzP7pR1Xq9_Rsa-ebfr7HQooIWT7HeSKNyhEAWtd9Y5-aJ31sRrcYZJ-vN7gIBF2af1gQrGvdhAQrI1BzRnS4 May 27 15:20:23.106408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:20:23.106408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:20:23.106408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:20:23.106408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:20:23.106408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:20:23.106408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:20:23.106408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: 58318fdd40dd469099dade09793f6b38 May 27 15:20:23.106408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-VolumesSnapshotTestJSON-926884528 May 27 15:20:23.106408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:20:23.106408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:20:23.107831 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/58318fdd40dd469099dade09793f6b38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_58318fdd40dd469099dade09793f6b38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/58318fdd40dd469099dade09793f6b38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/58318fdd40dd469099dade09793f6b38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:20:23.107831 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-VolumesSnapshotTestJSON-926884528 May 27 15:20:23.107831 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: 58318fdd40dd469099dade09793f6b38 May 27 15:20:23.107831 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-926884528 May 27 15:20:23.107831 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-VolumesSnapshotTestJSON-926884528-project May 27 15:20:23.107831 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:20:23.107831 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:20:23.107831 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: 0b257d6c8a034981be9b54789c313d3c May 27 15:20:23.107831 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-VolumesSnapshotTestJSON-926884528-project May 27 15:20:23.107831 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: > May 27 15:20:23.107831 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Instance 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 could not be found. May 27 15:20:23.107831 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'id': '5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1'} May 27 15:20:23.108569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:20:23.108569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:23.108569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:20:23.108569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:20:23.108569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:20:23.108569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:20:23.108569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:20:23.108569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:20:23.108569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:20:23.108569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:20:23.108569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 could not be found. May 27 15:20:23.108569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:23.108569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:23.108569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:23.108569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:23.108569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:23.108569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:23.108569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:20:23.108569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:20:23.108569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:20:23.109845 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:20:23.109845 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:20:23.109845 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:20:23.109845 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:20:23.109845 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:20:23.109845 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:20:23.109845 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:20:23.109845 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 could not be found. May 27 15:20:23.109845 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:23.109845 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:23.109845 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:23.109845 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:23.109845 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:23.109845 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:23.109845 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:20:23.109845 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:20:23.109845 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 could not be found. May 27 15:20:23.109845 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:23.111294 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9227d2fe-74fc-47f5-aabb-da71b3f8f141 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] Returning 404 to user: Instance 5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 could not be found. {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:20:23.111294 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9227d2fe-74fc-47f5-aabb-da71b3f8f141 tempest-VolumesSnapshotTestJSON-926884528 tempest-VolumesSnapshotTestJSON-926884528-project] 10.222.0.50 "GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1" status: 404 len: 111 microversion: 2.1 time: 0.042891 May 27 15:20:23.111294 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 367/761] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:23 2022] GET /compute/v2.1/servers/5dc9ff4c-6b01-40ec-a5aa-e2567b89a6d1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:20:23.841523 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e29d6fd1-1d90-4b13-a212-90c6599d6586 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:23.842510 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e29d6fd1-1d90-4b13-a212-90c6599d6586 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:23.852293 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e29d6fd1-1d90-4b13-a212-90c6599d6586 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:23.853100 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e29d6fd1-1d90-4b13-a212-90c6599d6586 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:23.854480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e29d6fd1-1d90-4b13-a212-90c6599d6586 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:23.855313 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e29d6fd1-1d90-4b13-a212-90c6599d6586 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:23.975289 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-65020935-52ee-4148-978c-efe48e3c1220 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:23.976705 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-65020935-52ee-4148-978c-efe48e3c1220 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:23.987976 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-65020935-52ee-4148-978c-efe48e3c1220 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:23.988800 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-65020935-52ee-4148-978c-efe48e3c1220 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:23.989713 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-65020935-52ee-4148-978c-efe48e3c1220 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:23.990248 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-65020935-52ee-4148-978c-efe48e3c1220 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:24.019067 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-e29d6fd1-1d90-4b13-a212-90c6599d6586 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:24.028476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-e29d6fd1-1d90-4b13-a212-90c6599d6586 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1549 microversion: 2.1 time: 0.192562 May 27 15:20:24.029058 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 395/762] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:23 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1549 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:24.045841 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-daad76dc-e22e-47a1-95fa-177bb9b6bc95 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:24.046342 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-daad76dc-e22e-47a1-95fa-177bb9b6bc95 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:24.058401 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-daad76dc-e22e-47a1-95fa-177bb9b6bc95 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:24.058877 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-daad76dc-e22e-47a1-95fa-177bb9b6bc95 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:24.059679 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-daad76dc-e22e-47a1-95fa-177bb9b6bc95 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:24.060123 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-daad76dc-e22e-47a1-95fa-177bb9b6bc95 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:24.175610 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-daad76dc-e22e-47a1-95fa-177bb9b6bc95 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.133664 May 27 15:20:24.176327 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 396/763] 10.222.0.50 () {58 vars in 1274 bytes} [Fri May 27 15:20:24 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:20:24.182273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-65020935-52ee-4148-978c-efe48e3c1220 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:24.192547 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-65020935-52ee-4148-978c-efe48e3c1220 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1266 microversion: 2.1 time: 0.223877 May 27 15:20:24.193347 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 368/764] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:23 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:25.213637 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-0c6d7625-0e5c-4e04-9d56-dd1cbd62d393 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:25.214326 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-b7c11ff4-294b-42d5-a09b-f721126a284a req-e12cd645-f527-49ba-b260-17ebb15ac00f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe4a7119-2de1-4f92-a310-bdd2eb2aa316", "tag": "37e04985-41a3-46a7-bd4a-0d11189b7fbf"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:25.214700 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-0c6d7625-0e5c-4e04-9d56-dd1cbd62d393 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:25.226562 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0c6d7625-0e5c-4e04-9d56-dd1cbd62d393 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:25.227668 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0c6d7625-0e5c-4e04-9d56-dd1cbd62d393 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:25.228942 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0c6d7625-0e5c-4e04-9d56-dd1cbd62d393 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:25.229422 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-b7c11ff4-294b-42d5-a09b-f721126a284a req-e12cd645-f527-49ba-b260-17ebb15ac00f service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:25.229661 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0c6d7625-0e5c-4e04-9d56-dd1cbd62d393 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:25.230142 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-b7c11ff4-294b-42d5-a09b-f721126a284a req-e12cd645-f527-49ba-b260-17ebb15ac00f service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:25.250252 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-b7c11ff4-294b-42d5-a09b-f721126a284a req-e12cd645-f527-49ba-b260-17ebb15ac00f service nova] Creating event network-changed:37e04985-41a3-46a7-bd4a-0d11189b7fbf for instance fe4a7119-2de1-4f92-a310-bdd2eb2aa316 on hv-cinder-84254 May 27 15:20:25.258945 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-b7c11ff4-294b-42d5-a09b-f721126a284a req-e12cd645-f527-49ba-b260-17ebb15ac00f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051541 May 27 15:20:25.259979 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 397/765] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:25.385134 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-0c6d7625-0e5c-4e04-9d56-dd1cbd62d393 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:25.398187 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-0c6d7625-0e5c-4e04-9d56-dd1cbd62d393 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1266 microversion: 2.1 time: 0.190700 May 27 15:20:25.399402 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 369/766] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:25 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:26.420289 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-445b3931-3d1a-4d4f-9f37-eb9cb8e440f5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:26.421332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-445b3931-3d1a-4d4f-9f37-eb9cb8e440f5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:26.428482 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-445b3931-3d1a-4d4f-9f37-eb9cb8e440f5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:26.428925 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-445b3931-3d1a-4d4f-9f37-eb9cb8e440f5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:26.429717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-445b3931-3d1a-4d4f-9f37-eb9cb8e440f5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:26.430132 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-445b3931-3d1a-4d4f-9f37-eb9cb8e440f5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:26.569337 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-445b3931-3d1a-4d4f-9f37-eb9cb8e440f5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:26.577019 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-445b3931-3d1a-4d4f-9f37-eb9cb8e440f5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1266 microversion: 2.1 time: 0.162685 May 27 15:20:26.577591 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 398/767] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:26 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:27.596348 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-7d5f1f7b-e188-4761-922a-edadef1d0ece tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:27.597166 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-7d5f1f7b-e188-4761-922a-edadef1d0ece tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:27.599662 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=2 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:27.605410 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-7d5f1f7b-e188-4761-922a-edadef1d0ece tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:27.605786 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-7d5f1f7b-e188-4761-922a-edadef1d0ece tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:27.606557 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-7d5f1f7b-e188-4761-922a-edadef1d0ece tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:27.607025 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-7d5f1f7b-e188-4761-922a-edadef1d0ece tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:28.020257 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-7d5f1f7b-e188-4761-922a-edadef1d0ece tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:28.033931 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-7d5f1f7b-e188-4761-922a-edadef1d0ece tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1266 microversion: 2.1 time: 0.442434 May 27 15:20:28.034760 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 370/768] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:27 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1266 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:29.048055 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=2 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:29.048733 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=6 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:29.053488 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-7e26c3be-e9de-4570-957a-5116d6d0d7f4 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:29.054107 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-7e26c3be-e9de-4570-957a-5116d6d0d7f4 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:29.061103 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7e26c3be-e9de-4570-957a-5116d6d0d7f4 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:29.061555 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7e26c3be-e9de-4570-957a-5116d6d0d7f4 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:29.062324 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7e26c3be-e9de-4570-957a-5116d6d0d7f4 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:29.062763 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7e26c3be-e9de-4570-957a-5116d6d0d7f4 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:29.367895 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-7e26c3be-e9de-4570-957a-5116d6d0d7f4 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:29.376732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-7e26c3be-e9de-4570-957a-5116d6d0d7f4 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1266 microversion: 2.1 time: 0.329708 May 27 15:20:29.377408 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 399/769] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:29 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1266 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:30.394749 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-308dda08-b476-4eda-a620-d4467d2fb950 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:30.395287 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-308dda08-b476-4eda-a620-d4467d2fb950 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:30.401938 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-308dda08-b476-4eda-a620-d4467d2fb950 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:30.402388 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-308dda08-b476-4eda-a620-d4467d2fb950 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:30.403186 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-308dda08-b476-4eda-a620-d4467d2fb950 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:30.403630 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-308dda08-b476-4eda-a620-d4467d2fb950 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:30.546057 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-308dda08-b476-4eda-a620-d4467d2fb950 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:30.554667 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-308dda08-b476-4eda-a620-d4467d2fb950 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1266 microversion: 2.1 time: 0.164677 May 27 15:20:30.555283 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 371/770] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:30 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:31.573109 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-2247b503-104f-4879-8edf-25fe541a767a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:31.573714 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-2247b503-104f-4879-8edf-25fe541a767a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:31.581160 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2247b503-104f-4879-8edf-25fe541a767a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:31.581608 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2247b503-104f-4879-8edf-25fe541a767a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:31.582373 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2247b503-104f-4879-8edf-25fe541a767a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:31.582804 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2247b503-104f-4879-8edf-25fe541a767a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:31.711542 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-2247b503-104f-4879-8edf-25fe541a767a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:31.719343 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-2247b503-104f-4879-8edf-25fe541a767a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1266 microversion: 2.1 time: 0.149771 May 27 15:20:31.719905 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 400/771] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:31 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:32.736987 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b28efbac-9a49-462b-89fc-dc05962311eb tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:32.737537 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b28efbac-9a49-462b-89fc-dc05962311eb tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:32.743983 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b28efbac-9a49-462b-89fc-dc05962311eb tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:32.744440 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b28efbac-9a49-462b-89fc-dc05962311eb tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:32.745218 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b28efbac-9a49-462b-89fc-dc05962311eb tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:32.745671 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b28efbac-9a49-462b-89fc-dc05962311eb tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:32.889267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b28efbac-9a49-462b-89fc-dc05962311eb tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:32.897240 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b28efbac-9a49-462b-89fc-dc05962311eb tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1266 microversion: 2.1 time: 0.164973 May 27 15:20:32.897803 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 372/772] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:32 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:33.914059 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-fde299b1-46f6-41b8-8fb6-1a86aa9c2084 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:33.914704 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-fde299b1-46f6-41b8-8fb6-1a86aa9c2084 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:33.921307 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fde299b1-46f6-41b8-8fb6-1a86aa9c2084 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:33.921756 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fde299b1-46f6-41b8-8fb6-1a86aa9c2084 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:33.923184 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fde299b1-46f6-41b8-8fb6-1a86aa9c2084 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:33.923624 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fde299b1-46f6-41b8-8fb6-1a86aa9c2084 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:34.060236 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-fde299b1-46f6-41b8-8fb6-1a86aa9c2084 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:34.068496 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-fde299b1-46f6-41b8-8fb6-1a86aa9c2084 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1266 microversion: 2.1 time: 0.158237 May 27 15:20:34.069082 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 401/773] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:33 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:35.086317 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-739b6441-1bba-42e0-9d01-cf1441b7502d tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:35.086996 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-739b6441-1bba-42e0-9d01-cf1441b7502d tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:35.093451 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-739b6441-1bba-42e0-9d01-cf1441b7502d tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:35.093992 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-739b6441-1bba-42e0-9d01-cf1441b7502d tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:35.095236 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-739b6441-1bba-42e0-9d01-cf1441b7502d tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:35.095685 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-739b6441-1bba-42e0-9d01-cf1441b7502d tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:35.392365 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-739b6441-1bba-42e0-9d01-cf1441b7502d tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:35.399919 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-739b6441-1bba-42e0-9d01-cf1441b7502d tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1266 microversion: 2.1 time: 0.318303 May 27 15:20:35.400688 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 373/774] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:35 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:36.417550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-9e13583d-a75b-4360-96f4-87ecc14ad95f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:36.419949 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-9e13583d-a75b-4360-96f4-87ecc14ad95f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:36.423019 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:36.428299 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9e13583d-a75b-4360-96f4-87ecc14ad95f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.428774 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9e13583d-a75b-4360-96f4-87ecc14ad95f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.429576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9e13583d-a75b-4360-96f4-87ecc14ad95f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:36.430010 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9e13583d-a75b-4360-96f4-87ecc14ad95f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:36.561449 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-9e13583d-a75b-4360-96f4-87ecc14ad95f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:36.569057 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-9e13583d-a75b-4360-96f4-87ecc14ad95f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1266 microversion: 2.1 time: 0.155437 May 27 15:20:36.569618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 402/775] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:36 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:37.316529 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-90adf427-03b3-4a56-a04d-bc1e746927b6 req-b2774e0a-108d-482a-bea5-bab7e97f2c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57293bbe-cb31-4f35-b133-3b8e673465cb", "name": "network-vif-plugged", "status": "completed", "tag": "9612e155-cd8f-4e21-816c-b8322b4a154e"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:37.326194 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-90adf427-03b3-4a56-a04d-bc1e746927b6 req-b2774e0a-108d-482a-bea5-bab7e97f2c9f service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.326667 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-90adf427-03b3-4a56-a04d-bc1e746927b6 req-b2774e0a-108d-482a-bea5-bab7e97f2c9f service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.342811 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-90adf427-03b3-4a56-a04d-bc1e746927b6 req-b2774e0a-108d-482a-bea5-bab7e97f2c9f service nova] Creating event network-vif-plugged:9612e155-cd8f-4e21-816c-b8322b4a154e for instance 57293bbe-cb31-4f35-b133-3b8e673465cb on hv-cinder-84254 May 27 15:20:37.348876 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-90adf427-03b3-4a56-a04d-bc1e746927b6 req-b2774e0a-108d-482a-bea5-bab7e97f2c9f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036801 May 27 15:20:37.349465 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 374/776] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:37.585603 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ff8574d7-51fb-4a41-a67f-f383774db79f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:37.586391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ff8574d7-51fb-4a41-a67f-f383774db79f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:37.592518 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ff8574d7-51fb-4a41-a67f-f383774db79f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.593154 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ff8574d7-51fb-4a41-a67f-f383774db79f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.594532 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ff8574d7-51fb-4a41-a67f-f383774db79f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:37.595407 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ff8574d7-51fb-4a41-a67f-f383774db79f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:37.746651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-ff8574d7-51fb-4a41-a67f-f383774db79f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:37.754670 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ff8574d7-51fb-4a41-a67f-f383774db79f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1266 microversion: 2.1 time: 0.173093 May 27 15:20:37.755279 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 403/777] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:37 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:38.771919 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-c98c306f-c8ea-44c1-af15-431d04ab7195 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:38.772613 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-c98c306f-c8ea-44c1-af15-431d04ab7195 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:38.775075 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_api:SELECT=72 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:38.780785 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c98c306f-c8ea-44c1-af15-431d04ab7195 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:38.781233 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c98c306f-c8ea-44c1-af15-431d04ab7195 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:38.782005 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c98c306f-c8ea-44c1-af15-431d04ab7195 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:38.782468 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c98c306f-c8ea-44c1-af15-431d04ab7195 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:38.919657 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-c98c306f-c8ea-44c1-af15-431d04ab7195 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:38.928211 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-c98c306f-c8ea-44c1-af15-431d04ab7195 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1266 microversion: 2.1 time: 0.160416 May 27 15:20:38.928970 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 375/778] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:38 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:39.946043 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-9d37bf94-b177-4253-90da-5e44a6ba2b91 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:39.946759 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-9d37bf94-b177-4253-90da-5e44a6ba2b91 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:39.953515 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9d37bf94-b177-4253-90da-5e44a6ba2b91 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:39.953964 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9d37bf94-b177-4253-90da-5e44a6ba2b91 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:39.955571 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9d37bf94-b177-4253-90da-5e44a6ba2b91 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:39.956143 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9d37bf94-b177-4253-90da-5e44a6ba2b91 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:40.087263 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-9d37bf94-b177-4253-90da-5e44a6ba2b91 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:40.090673 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=100 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:40.096157 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-9d37bf94-b177-4253-90da-5e44a6ba2b91 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1453 microversion: 2.1 time: 0.154150 May 27 15:20:40.096729 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 404/779] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:39 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:40.112211 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-816688e0-296a-4a63-8f6c-f7593ba33b7a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:40.112823 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-816688e0-296a-4a63-8f6c-f7593ba33b7a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:40.119475 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-816688e0-296a-4a63-8f6c-f7593ba33b7a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:40.119927 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-816688e0-296a-4a63-8f6c-f7593ba33b7a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:40.120734 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-816688e0-296a-4a63-8f6c-f7593ba33b7a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:40.121169 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-816688e0-296a-4a63-8f6c-f7593ba33b7a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:40.260956 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-816688e0-296a-4a63-8f6c-f7593ba33b7a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:40.268712 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-816688e0-296a-4a63-8f6c-f7593ba33b7a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1453 microversion: 2.1 time: 0.160392 May 27 15:20:40.269273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 376/780] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:40 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:42.105740 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-a7bc9431-3623-4e32-9df7-2a9955b72633 req-3eb14b82-5bb2-48eb-ab89-0a46d1f86060 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57293bbe-cb31-4f35-b133-3b8e673465cb", "tag": "9612e155-cd8f-4e21-816c-b8322b4a154e"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:42.116677 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-a7bc9431-3623-4e32-9df7-2a9955b72633 req-3eb14b82-5bb2-48eb-ab89-0a46d1f86060 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:42.117218 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-a7bc9431-3623-4e32-9df7-2a9955b72633 req-3eb14b82-5bb2-48eb-ab89-0a46d1f86060 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:42.131158 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-a7bc9431-3623-4e32-9df7-2a9955b72633 req-3eb14b82-5bb2-48eb-ab89-0a46d1f86060 service nova] Creating event network-changed:9612e155-cd8f-4e21-816c-b8322b4a154e for instance 57293bbe-cb31-4f35-b133-3b8e673465cb on hv-cinder-84254 May 27 15:20:42.136305 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-a7bc9431-3623-4e32-9df7-2a9955b72633 req-3eb14b82-5bb2-48eb-ab89-0a46d1f86060 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034941 May 27 15:20:42.137413 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 405/781] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:51.816944 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-31841e25-4233-44a4-8993-784123f5e664 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:51.817477 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-31841e25-4233-44a4-8993-784123f5e664 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:51.819487 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_api:SELECT=3 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:51.820136 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=72 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:20:51.826282 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-31841e25-4233-44a4-8993-784123f5e664 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:51.826733 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-31841e25-4233-44a4-8993-784123f5e664 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:51.827537 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-31841e25-4233-44a4-8993-784123f5e664 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:51.827980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-31841e25-4233-44a4-8993-784123f5e664 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:51.909900 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.objects.instance [None req-31841e25-4233-44a4-8993-784123f5e664 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lazy-loading 'services' on Instance uuid 5b91f595-1d49-4eed-8d8c-57bb287d34b5 {{(pid=117743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:20:52.035583 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-31841e25-4233-44a4-8993-784123f5e664 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5/os-volume_attachments/36e5f894-423a-45b0-bfdc-0e96d179895c" status: 202 len: 0 microversion: 2.1 time: 0.222519 May 27 15:20:52.036352 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 377/782] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 15:20:51 2022] DELETE /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5/os-volume_attachments/36e5f894-423a-45b0-bfdc-0e96d179895c => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:20:52.046775 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-c6c366ca-2c86-405e-850a-fc4d7e3a288b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:52.047839 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-c6c366ca-2c86-405e-850a-fc4d7e3a288b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:52.055976 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c6c366ca-2c86-405e-850a-fc4d7e3a288b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:52.056489 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c6c366ca-2c86-405e-850a-fc4d7e3a288b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:52.057470 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c6c366ca-2c86-405e-850a-fc4d7e3a288b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:52.057962 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c6c366ca-2c86-405e-850a-fc4d7e3a288b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:52.092428 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-c6c366ca-2c86-405e-850a-fc4d7e3a288b tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050141 May 27 15:20:52.093624 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 406/783] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 15:20:52 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:20:53.106426 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-ab031a5f-0844-404d-99cd-dd21b6204596 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:53.107458 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-ab031a5f-0844-404d-99cd-dd21b6204596 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:53.113640 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ab031a5f-0844-404d-99cd-dd21b6204596 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:53.114090 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ab031a5f-0844-404d-99cd-dd21b6204596 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:53.114876 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ab031a5f-0844-404d-99cd-dd21b6204596 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:53.115325 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ab031a5f-0844-404d-99cd-dd21b6204596 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:53.146964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-ab031a5f-0844-404d-99cd-dd21b6204596 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045351 May 27 15:20:53.147532 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 378/784] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 15:20:53 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:20:53.226422 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f6cb7bc0-1ead-4908-bfb2-5cd0710d943c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:53.227047 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f6cb7bc0-1ead-4908-bfb2-5cd0710d943c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:53.233373 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f6cb7bc0-1ead-4908-bfb2-5cd0710d943c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:53.233819 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f6cb7bc0-1ead-4908-bfb2-5cd0710d943c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:53.234578 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f6cb7bc0-1ead-4908-bfb2-5cd0710d943c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:53.235050 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f6cb7bc0-1ead-4908-bfb2-5cd0710d943c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:53.259100 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f6cb7bc0-1ead-4908-bfb2-5cd0710d943c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Going to try to terminate instance {{(pid=117742) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:20:53.333593 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f6cb7bc0-1ead-4908-bfb2-5cd0710d943c tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 204 len: 0 microversion: 2.1 time: 0.110730 May 27 15:20:53.334289 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 407/785] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:20:53 2022] DELETE /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:20:53.342479 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-063b1936-b533-4a2e-8291-511e2532f565 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:53.343104 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-063b1936-b533-4a2e-8291-511e2532f565 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:53.349667 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-063b1936-b533-4a2e-8291-511e2532f565 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:53.350121 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-063b1936-b533-4a2e-8291-511e2532f565 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:53.350921 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-063b1936-b533-4a2e-8291-511e2532f565 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:53.351366 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-063b1936-b533-4a2e-8291-511e2532f565 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:53.497851 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-063b1936-b533-4a2e-8291-511e2532f565 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:53.506003 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-063b1936-b533-4a2e-8291-511e2532f565 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1689 microversion: 2.1 time: 0.167571 May 27 15:20:53.506578 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 379/786] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:53 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:54.524136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-761bd879-9893-4feb-8345-3511ac73208e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:54.524821 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-761bd879-9893-4feb-8345-3511ac73208e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:54.531834 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-761bd879-9893-4feb-8345-3511ac73208e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:54.532276 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-761bd879-9893-4feb-8345-3511ac73208e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:54.533034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-761bd879-9893-4feb-8345-3511ac73208e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:54.533462 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-761bd879-9893-4feb-8345-3511ac73208e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:54.661540 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-761bd879-9893-4feb-8345-3511ac73208e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:54.669046 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-761bd879-9893-4feb-8345-3511ac73208e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1689 microversion: 2.1 time: 0.149326 May 27 15:20:54.669604 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 408/787] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:54 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:55.685439 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b1ab568f-10ee-4c00-b1cb-a12a61ad01a6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:55.686043 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b1ab568f-10ee-4c00-b1cb-a12a61ad01a6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:55.692724 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b1ab568f-10ee-4c00-b1cb-a12a61ad01a6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:55.693167 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b1ab568f-10ee-4c00-b1cb-a12a61ad01a6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:55.693924 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b1ab568f-10ee-4c00-b1cb-a12a61ad01a6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:55.694356 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b1ab568f-10ee-4c00-b1cb-a12a61ad01a6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:56.010888 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b1ab568f-10ee-4c00-b1cb-a12a61ad01a6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:56.018619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b1ab568f-10ee-4c00-b1cb-a12a61ad01a6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1689 microversion: 2.1 time: 0.336849 May 27 15:20:56.019230 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 380/788] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:55 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1689 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:57.036002 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-fe4bba7b-3d72-442d-9a33-fdba873701f1 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:57.036770 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-fe4bba7b-3d72-442d-9a33-fdba873701f1 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:57.043385 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fe4bba7b-3d72-442d-9a33-fdba873701f1 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:57.043835 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fe4bba7b-3d72-442d-9a33-fdba873701f1 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:57.044598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fe4bba7b-3d72-442d-9a33-fdba873701f1 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:57.045036 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fe4bba7b-3d72-442d-9a33-fdba873701f1 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:57.174177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-fe4bba7b-3d72-442d-9a33-fdba873701f1 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:57.181889 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-fe4bba7b-3d72-442d-9a33-fdba873701f1 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1689 microversion: 2.1 time: 0.150014 May 27 15:20:57.182456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 409/789] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:57 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:20:58.172634 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-ef53f0a8-357b-45ea-91d6-dc7678e4bc95 req-2f2afed0-6a9a-46ef-bca1-a5b85cdcd0ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b91f595-1d49-4eed-8d8c-57bb287d34b5", "name": "network-vif-deleted", "tag": "912582f8-c57d-4774-8d6c-0a14883de730"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:20:58.182101 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-ef53f0a8-357b-45ea-91d6-dc7678e4bc95 req-2f2afed0-6a9a-46ef-bca1-a5b85cdcd0ab service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:58.182553 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-ef53f0a8-357b-45ea-91d6-dc7678e4bc95 req-2f2afed0-6a9a-46ef-bca1-a5b85cdcd0ab service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:58.193850 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-ef53f0a8-357b-45ea-91d6-dc7678e4bc95 req-2f2afed0-6a9a-46ef-bca1-a5b85cdcd0ab service nova] Creating event network-vif-deleted:912582f8-c57d-4774-8d6c-0a14883de730 for instance 5b91f595-1d49-4eed-8d8c-57bb287d34b5 on hv-cinder-84254 May 27 15:20:58.199003 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-ef53f0a8-357b-45ea-91d6-dc7678e4bc95 req-2f2afed0-6a9a-46ef-bca1-a5b85cdcd0ab service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030531 May 27 15:20:58.199880 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 381/790] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:20:58.200252 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-41d4bdfb-8f2f-429e-ab16-cb4049b4a5df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:58.201443 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-41d4bdfb-8f2f-429e-ab16-cb4049b4a5df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:58.209366 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-41d4bdfb-8f2f-429e-ab16-cb4049b4a5df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:58.210238 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-41d4bdfb-8f2f-429e-ab16-cb4049b4a5df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:58.211381 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-41d4bdfb-8f2f-429e-ab16-cb4049b4a5df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:58.212070 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-41d4bdfb-8f2f-429e-ab16-cb4049b4a5df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:58.286587 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-41d4bdfb-8f2f-429e-ab16-cb4049b4a5df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:20:58.294981 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-41d4bdfb-8f2f-429e-ab16-cb4049b4a5df tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 200 len: 1330 microversion: 2.1 time: 0.100001 May 27 15:20:58.295850 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 410/791] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:58 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 1330 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:20:59.312975 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-c98ec418-8a03-4c3f-b0cd-bd8699919e34 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:59.313703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-c98ec418-8a03-4c3f-b0cd-bd8699919e34 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5b91f595-1d49-4eed-8d8c-57bb287d34b5] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:20:59.320010 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c98ec418-8a03-4c3f-b0cd-bd8699919e34 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:59.320496 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c98ec418-8a03-4c3f-b0cd-bd8699919e34 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:59.321258 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c98ec418-8a03-4c3f-b0cd-bd8699919e34 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:20:59.321696 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c98ec418-8a03-4c3f-b0cd-bd8699919e34 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:20:59.334768 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-c98ec418-8a03-4c3f-b0cd-bd8699919e34 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] HTTP exception thrown: Instance 5b91f595-1d49-4eed-8d8c-57bb287d34b5 could not be found. May 27 15:20:59.336368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-c98ec418-8a03-4c3f-b0cd-bd8699919e34 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Request method failure captured: May 27 15:20:59.336368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 HTTP/1.1 May 27 15:20:59.336368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:20:59.336368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:20:59.336368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:20:59.336368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 0 May 27 15:20:59.336368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:20:59.336368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:20:59.336368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:20:59.336368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:20:59.336368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOsskJv0Za1_r4uQKA_pi415_6wML-p1mRVGBWD8lWuud7bzAGolysbWk-OZBZUDOlh33cVz8_cStEJa1_A3rWwn3mlg65e6M9osS70eYm9HT9aGfMK1PAt0mA1rcJnxNqZvqN2lltoyozOfD_R1N4W67Q6b0UC8RqROVyLsQCTGw-I May 27 15:20:59.336368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:20:59.336368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:20:59.336368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:20:59.336368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:20:59.336368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:20:59.336368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:20:59.336368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: c208c3d86c504ea086bf763e241cbc88 May 27 15:20:59.336368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1899191250 May 27 15:20:59.336368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:20:59.336368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:20:59.337962 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c208c3d86c504ea086bf763e241cbc88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c208c3d86c504ea086bf763e241cbc88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c208c3d86c504ea086bf763e241cbc88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c208c3d86c504ea086bf763e241cbc88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:20:59.337962 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1899191250 May 27 15:20:59.337962 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: c208c3d86c504ea086bf763e241cbc88 May 27 15:20:59.337962 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1899191250 May 27 15:20:59.337962 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-ServerRescueNegativeTestJSON-1899191250-project May 27 15:20:59.337962 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:20:59.337962 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:20:59.337962 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: 9c9149cb2b3c423796164b487a305bbd May 27 15:20:59.337962 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1899191250-project May 27 15:20:59.337962 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: > May 27 15:20:59.337962 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Instance 5b91f595-1d49-4eed-8d8c-57bb287d34b5 could not be found. May 27 15:20:59.337962 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'id': '5b91f595-1d49-4eed-8d8c-57bb287d34b5'} May 27 15:20:59.339550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:20:59.339550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:59.339550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:20:59.339550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:20:59.339550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:20:59.339550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:20:59.339550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:20:59.339550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:20:59.339550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:20:59.339550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:20:59.339550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b91f595-1d49-4eed-8d8c-57bb287d34b5 could not be found. May 27 15:20:59.339550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:59.339550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:59.339550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:59.339550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:59.339550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:59.339550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:59.339550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:20:59.339550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:20:59.339550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:20:59.341067 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:20:59.341067 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:20:59.341067 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:20:59.341067 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:20:59.341067 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:20:59.341067 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:20:59.341067 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:20:59.341067 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b91f595-1d49-4eed-8d8c-57bb287d34b5 could not be found. May 27 15:20:59.341067 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:59.341067 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:20:59.341067 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:59.341067 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:20:59.341067 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:20:59.341067 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:20:59.341067 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:20:59.341067 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:20:59.341067 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b91f595-1d49-4eed-8d8c-57bb287d34b5 could not be found. May 27 15:20:59.341067 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:20:59.342356 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-c98ec418-8a03-4c3f-b0cd-bd8699919e34 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Returning 404 to user: Instance 5b91f595-1d49-4eed-8d8c-57bb287d34b5 could not be found. {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:20:59.342356 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-c98ec418-8a03-4c3f-b0cd-bd8699919e34 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5" status: 404 len: 111 microversion: 2.1 time: 0.029479 May 27 15:20:59.342356 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 382/792] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:20:59 2022] GET /compute/v2.1/servers/5b91f595-1d49-4eed-8d8c-57bb287d34b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:20:59.346622 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-77239293-0020-46ec-bcb6-3a39f6a7ccc7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '.version_select at 0x7f57e186eaf0>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:20:59.364511 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-77239293-0020-46ec-bcb6-3a39f6a7ccc7 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1584833569" status: 202 len: 0 microversion: 2.1 time: 0.021965 May 27 15:20:59.365277 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 411/793] 10.222.0.50 () {58 vars in 1220 bytes} [Fri May 27 15:20:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1584833569 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:21:01.029432 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b7b9cb5f-c77d-4a81-a58e-bc60ccac2e65 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:01.030008 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b7b9cb5f-c77d-4a81-a58e-bc60ccac2e65 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:01.036448 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b7b9cb5f-c77d-4a81-a58e-bc60ccac2e65 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:01.036898 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b7b9cb5f-c77d-4a81-a58e-bc60ccac2e65 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:01.038247 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b7b9cb5f-c77d-4a81-a58e-bc60ccac2e65 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:01.038714 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b7b9cb5f-c77d-4a81-a58e-bc60ccac2e65 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:01.062031 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b7b9cb5f-c77d-4a81-a58e-bc60ccac2e65 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe/ips" status: 200 len: 152 microversion: 2.20 time: 0.036549 May 27 15:21:01.062605 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 383/794] 10.222.0.50 () {60 vars in 1288 bytes} [Fri May 27 15:21:01 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:21:02.244479 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-6cdfce29-4639-448d-adb7-5869db979ab6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:02.244981 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-6cdfce29-4639-448d-adb7-5869db979ab6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:02.252137 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6cdfce29-4639-448d-adb7-5869db979ab6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:02.252587 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6cdfce29-4639-448d-adb7-5869db979ab6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:02.253348 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6cdfce29-4639-448d-adb7-5869db979ab6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:02.253784 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6cdfce29-4639-448d-adb7-5869db979ab6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:02.279766 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-6cdfce29-4639-448d-adb7-5869db979ab6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Going to try to terminate instance {{(pid=117742) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:21:02.355403 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-6cdfce29-4639-448d-adb7-5869db979ab6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 204 len: 0 microversion: 2.1 time: 0.115139 May 27 15:21:02.358791 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 412/795] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:21:02 2022] DELETE /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:21:02.363887 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b830dd43-6d47-4d3e-9d02-37c500cd598e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:02.364500 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b830dd43-6d47-4d3e-9d02-37c500cd598e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:02.372016 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b830dd43-6d47-4d3e-9d02-37c500cd598e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:02.372468 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b830dd43-6d47-4d3e-9d02-37c500cd598e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:02.373241 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b830dd43-6d47-4d3e-9d02-37c500cd598e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:02.373678 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b830dd43-6d47-4d3e-9d02-37c500cd598e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:02.506059 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b830dd43-6d47-4d3e-9d02-37c500cd598e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:02.513811 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b830dd43-6d47-4d3e-9d02-37c500cd598e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1508 microversion: 2.1 time: 0.153751 May 27 15:21:02.514375 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 384/796] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:02 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:03.396791 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e4ca6b7d-3fad-4b4b-8e78-5c12069549bd tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:03.397934 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e4ca6b7d-3fad-4b4b-8e78-5c12069549bd tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:03.404427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e4ca6b7d-3fad-4b4b-8e78-5c12069549bd tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:03.404812 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e4ca6b7d-3fad-4b4b-8e78-5c12069549bd tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:03.405562 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e4ca6b7d-3fad-4b4b-8e78-5c12069549bd tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:03.405988 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e4ca6b7d-3fad-4b4b-8e78-5c12069549bd tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:03.428424 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.objects.instance [None req-e4ca6b7d-3fad-4b4b-8e78-5c12069549bd tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lazy-loading 'flavor' on Instance uuid f1c52039-f595-4f22-9df9-ea3a999f55fe {{(pid=117742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:21:03.531036 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-2fdbade6-65f8-489e-8c78-e243b328ab04 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:03.531811 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-2fdbade6-65f8-489e-8c78-e243b328ab04 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:03.539337 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2fdbade6-65f8-489e-8c78-e243b328ab04 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:03.539792 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2fdbade6-65f8-489e-8c78-e243b328ab04 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:03.540558 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2fdbade6-65f8-489e-8c78-e243b328ab04 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:03.540998 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2fdbade6-65f8-489e-8c78-e243b328ab04 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:03.672062 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-2fdbade6-65f8-489e-8c78-e243b328ab04 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:03.679995 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-2fdbade6-65f8-489e-8c78-e243b328ab04 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1508 microversion: 2.1 time: 0.152931 May 27 15:21:03.680564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 385/797] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:03 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:03.694980 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-e4ca6b7d-3fad-4b4b-8e78-5c12069549bd tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "POST /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe/action" status: 202 len: 0 microversion: 2.20 time: 0.301697 May 27 15:21:03.695622 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 413/798] 10.222.0.50 () {62 vars in 1318 bytes} [Fri May 27 15:21:03 2022] POST /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 15:21:03.704083 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-31cc5341-5900-45ee-8ec6-8e4781ec09e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:03.704723 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-31cc5341-5900-45ee-8ec6-8e4781ec09e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:03.711523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-31cc5341-5900-45ee-8ec6-8e4781ec09e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:03.711978 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-31cc5341-5900-45ee-8ec6-8e4781ec09e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:03.712744 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-31cc5341-5900-45ee-8ec6-8e4781ec09e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:03.713184 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-31cc5341-5900-45ee-8ec6-8e4781ec09e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:03.844724 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-31cc5341-5900-45ee-8ec6-8e4781ec09e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:03.852642 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-31cc5341-5900-45ee-8ec6-8e4781ec09e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:03.854147 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-31cc5341-5900-45ee-8ec6-8e4781ec09e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:03.855349 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-31cc5341-5900-45ee-8ec6-8e4781ec09e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1725 microversion: 2.20 time: 0.155258 May 27 15:21:03.855912 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 386/799] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:03 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:04.700789 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-6d7a8387-7165-410c-a3c5-c499a4ae1f32 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:04.701493 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-6d7a8387-7165-410c-a3c5-c499a4ae1f32 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:04.707822 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6d7a8387-7165-410c-a3c5-c499a4ae1f32 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:04.708277 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6d7a8387-7165-410c-a3c5-c499a4ae1f32 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:04.709043 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6d7a8387-7165-410c-a3c5-c499a4ae1f32 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:04.709485 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6d7a8387-7165-410c-a3c5-c499a4ae1f32 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:04.838962 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6d7a8387-7165-410c-a3c5-c499a4ae1f32 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:04.846728 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-6d7a8387-7165-410c-a3c5-c499a4ae1f32 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1508 microversion: 2.1 time: 0.150854 May 27 15:21:04.847322 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 414/800] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:04 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:04.873555 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-386bda19-f43e-4d14-b2ad-bc8b70dd2bdb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:04.874164 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-386bda19-f43e-4d14-b2ad-bc8b70dd2bdb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:04.880641 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-386bda19-f43e-4d14-b2ad-bc8b70dd2bdb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:04.881091 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-386bda19-f43e-4d14-b2ad-bc8b70dd2bdb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:04.881852 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-386bda19-f43e-4d14-b2ad-bc8b70dd2bdb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:04.882286 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-386bda19-f43e-4d14-b2ad-bc8b70dd2bdb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:05.016877 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-386bda19-f43e-4d14-b2ad-bc8b70dd2bdb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:05.025583 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-386bda19-f43e-4d14-b2ad-bc8b70dd2bdb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:05.027131 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-386bda19-f43e-4d14-b2ad-bc8b70dd2bdb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:05.028274 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-386bda19-f43e-4d14-b2ad-bc8b70dd2bdb tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1725 microversion: 2.20 time: 0.158601 May 27 15:21:05.028865 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 387/801] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:04 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:05.609499 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-15fa9c0a-29e4-437e-b9f4-a7b3eb7cfc5c req-8d008235-f81c-4f48-9f64-341fee09cf49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5efffda6-ae04-4920-bec6-eabacf6739e8", "name": "network-vif-deleted", "tag": "8b326e02-fd49-4a67-a328-487945327c6b"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:05.623683 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-15fa9c0a-29e4-437e-b9f4-a7b3eb7cfc5c req-8d008235-f81c-4f48-9f64-341fee09cf49 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:05.624284 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-15fa9c0a-29e4-437e-b9f4-a7b3eb7cfc5c req-8d008235-f81c-4f48-9f64-341fee09cf49 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:05.636682 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-15fa9c0a-29e4-437e-b9f4-a7b3eb7cfc5c req-8d008235-f81c-4f48-9f64-341fee09cf49 service nova] Creating event network-vif-deleted:8b326e02-fd49-4a67-a328-487945327c6b for instance 5efffda6-ae04-4920-bec6-eabacf6739e8 on hv-cinder-84254 May 27 15:21:05.641664 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-15fa9c0a-29e4-437e-b9f4-a7b3eb7cfc5c req-8d008235-f81c-4f48-9f64-341fee09cf49 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035784 May 27 15:21:05.642768 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 415/802] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:05.865011 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d95f5007-539a-4dd8-9672-27aefd56e164 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:05.865569 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-d95f5007-539a-4dd8-9672-27aefd56e164 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:05.872754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d95f5007-539a-4dd8-9672-27aefd56e164 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:05.873257 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d95f5007-539a-4dd8-9672-27aefd56e164 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:05.874083 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d95f5007-539a-4dd8-9672-27aefd56e164 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:05.874612 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d95f5007-539a-4dd8-9672-27aefd56e164 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:05.910927 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d95f5007-539a-4dd8-9672-27aefd56e164 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:05.911408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d95f5007-539a-4dd8-9672-27aefd56e164 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:05.912039 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.objects.instance [None req-d95f5007-539a-4dd8-9672-27aefd56e164 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lazy-loading 'fault' on Instance uuid 5efffda6-ae04-4920-bec6-eabacf6739e8 {{(pid=117743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:21:05.954289 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d95f5007-539a-4dd8-9672-27aefd56e164 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:05.962118 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-d95f5007-539a-4dd8-9672-27aefd56e164 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 200 len: 1312 microversion: 2.1 time: 0.101559 May 27 15:21:05.962701 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 388/803] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:05 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:06.047530 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-6a1fb401-fbad-4aa9-abad-a2833f6e5e09 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:06.048273 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-6a1fb401-fbad-4aa9-abad-a2833f6e5e09 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:06.055752 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6a1fb401-fbad-4aa9-abad-a2833f6e5e09 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:06.056239 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6a1fb401-fbad-4aa9-abad-a2833f6e5e09 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:06.057064 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6a1fb401-fbad-4aa9-abad-a2833f6e5e09 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:06.057527 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6a1fb401-fbad-4aa9-abad-a2833f6e5e09 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:06.189104 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-c416e73f-a370-44f1-aac1-a49dec1f7f1c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:06.189768 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-c416e73f-a370-44f1-aac1-a49dec1f7f1c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:06.195989 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6a1fb401-fbad-4aa9-abad-a2833f6e5e09 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:06.206118 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6a1fb401-fbad-4aa9-abad-a2833f6e5e09 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:06.207660 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6a1fb401-fbad-4aa9-abad-a2833f6e5e09 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:06.208826 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-6a1fb401-fbad-4aa9-abad-a2833f6e5e09 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1725 microversion: 2.20 time: 0.166448 May 27 15:21:06.211261 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c416e73f-a370-44f1-aac1-a49dec1f7f1c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:06.211709 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c416e73f-a370-44f1-aac1-a49dec1f7f1c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:06.212486 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c416e73f-a370-44f1-aac1-a49dec1f7f1c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:06.212915 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c416e73f-a370-44f1-aac1-a49dec1f7f1c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:06.216729 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 416/804] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:06 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:06.236642 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-c416e73f-a370-44f1-aac1-a49dec1f7f1c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/ips" status: 200 len: 146 microversion: 2.1 time: 0.051871 May 27 15:21:06.237208 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 389/805] 10.222.0.50 () {58 vars in 1247 bytes} [Fri May 27 15:21:06 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/ips => generated 146 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:21:06.979902 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-03b7b615-ee47-4070-82f3-509db1d60573 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:06.980518 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-03b7b615-ee47-4070-82f3-509db1d60573 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5efffda6-ae04-4920-bec6-eabacf6739e8] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:06.982665 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:06.988565 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-03b7b615-ee47-4070-82f3-509db1d60573 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:06.989014 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-03b7b615-ee47-4070-82f3-509db1d60573 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:06.989785 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-03b7b615-ee47-4070-82f3-509db1d60573 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:06.990224 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-03b7b615-ee47-4070-82f3-509db1d60573 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:07.004843 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-03b7b615-ee47-4070-82f3-509db1d60573 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] HTTP exception thrown: Instance 5efffda6-ae04-4920-bec6-eabacf6739e8 could not be found. May 27 15:21:07.006569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-03b7b615-ee47-4070-82f3-509db1d60573 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Request method failure captured: May 27 15:21:07.006569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 HTTP/1.1 May 27 15:21:07.006569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:21:07.006569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:21:07.006569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:21:07.006569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:21:07.006569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:21:07.006569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:21:07.006569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:21:07.006569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:21:07.006569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOsskJv0Za1_r4uQKA_pi415_6wML-p1mRVGBWD8lWuud7bzAGolysbWk-OZBZUDOlh33cVz8_cStEJa1_A3rWwn3mlg65e6M9osS70eYm9HT9aGfMK1PAt0mA1rcJnxNqZvqN2lltoyozOfD_R1N4W67Q6b0UC8RqROVyLsQCTGw-I May 27 15:21:07.006569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:21:07.006569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:21:07.006569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:21:07.006569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:21:07.006569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:21:07.006569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:21:07.006569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: c208c3d86c504ea086bf763e241cbc88 May 27 15:21:07.006569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1899191250 May 27 15:21:07.006569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:21:07.006569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:21:07.008643 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c208c3d86c504ea086bf763e241cbc88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c208c3d86c504ea086bf763e241cbc88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c208c3d86c504ea086bf763e241cbc88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c208c3d86c504ea086bf763e241cbc88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:21:07.008643 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1899191250 May 27 15:21:07.008643 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: c208c3d86c504ea086bf763e241cbc88 May 27 15:21:07.008643 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1899191250 May 27 15:21:07.008643 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-ServerRescueNegativeTestJSON-1899191250-project May 27 15:21:07.008643 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:21:07.008643 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:21:07.008643 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 9c9149cb2b3c423796164b487a305bbd May 27 15:21:07.008643 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1899191250-project May 27 15:21:07.008643 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:21:07.008643 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance 5efffda6-ae04-4920-bec6-eabacf6739e8 could not be found. May 27 15:21:07.008643 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': '5efffda6-ae04-4920-bec6-eabacf6739e8'} May 27 15:21:07.009722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:21:07.009722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:07.009722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:21:07.009722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:21:07.009722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:21:07.009722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:21:07.009722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:21:07.009722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:21:07.009722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:21:07.009722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:21:07.009722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5efffda6-ae04-4920-bec6-eabacf6739e8 could not be found. May 27 15:21:07.009722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:21:07.009722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:07.009722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:21:07.009722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:07.009722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:07.009722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:07.009722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:21:07.009722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:21:07.009722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:21:07.011864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:21:07.011864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:21:07.011864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:21:07.011864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:21:07.011864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:21:07.011864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:21:07.011864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:21:07.011864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5efffda6-ae04-4920-bec6-eabacf6739e8 could not be found. May 27 15:21:07.011864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:21:07.011864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:07.011864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:21:07.011864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:07.011864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:07.011864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:07.011864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:21:07.011864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:21:07.011864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5efffda6-ae04-4920-bec6-eabacf6739e8 could not be found. May 27 15:21:07.011864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:21:07.014060 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-03b7b615-ee47-4070-82f3-509db1d60573 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Returning 404 to user: Instance 5efffda6-ae04-4920-bec6-eabacf6739e8 could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:21:07.014060 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-03b7b615-ee47-4070-82f3-509db1d60573 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8" status: 404 len: 111 microversion: 2.1 time: 0.033173 May 27 15:21:07.014060 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 417/806] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:06 2022] GET /compute/v2.1/servers/5efffda6-ae04-4920-bec6-eabacf6739e8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:21:07.017578 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-2ea7d4dc-42e4-4a67-b5a1-75247330a7f6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:07.018076 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-2ea7d4dc-42e4-4a67-b5a1-75247330a7f6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:07.025334 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2ea7d4dc-42e4-4a67-b5a1-75247330a7f6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:07.025787 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2ea7d4dc-42e4-4a67-b5a1-75247330a7f6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:07.026552 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2ea7d4dc-42e4-4a67-b5a1-75247330a7f6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:07.027030 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2ea7d4dc-42e4-4a67-b5a1-75247330a7f6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:07.051451 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-2ea7d4dc-42e4-4a67-b5a1-75247330a7f6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Going to try to terminate instance {{(pid=117743) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:21:07.132440 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-2ea7d4dc-42e4-4a67-b5a1-75247330a7f6 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 204 len: 0 microversion: 2.1 time: 0.118430 May 27 15:21:07.134112 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 390/807] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:21:07 2022] DELETE /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:21:07.142255 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ca0ec2ef-817e-426d-96a1-80e01e039c6a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:07.142904 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ca0ec2ef-817e-426d-96a1-80e01e039c6a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:07.150048 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ca0ec2ef-817e-426d-96a1-80e01e039c6a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:07.150820 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ca0ec2ef-817e-426d-96a1-80e01e039c6a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:07.151852 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ca0ec2ef-817e-426d-96a1-80e01e039c6a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:07.152454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ca0ec2ef-817e-426d-96a1-80e01e039c6a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:07.228262 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a80e2749-e702-4f9d-8a47-2e851f95b01e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:07.228962 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a80e2749-e702-4f9d-8a47-2e851f95b01e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:07.235258 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a80e2749-e702-4f9d-8a47-2e851f95b01e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:07.235650 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a80e2749-e702-4f9d-8a47-2e851f95b01e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:07.236465 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a80e2749-e702-4f9d-8a47-2e851f95b01e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:07.236907 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a80e2749-e702-4f9d-8a47-2e851f95b01e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:07.318081 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-ca0ec2ef-817e-426d-96a1-80e01e039c6a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:07.326146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ca0ec2ef-817e-426d-96a1-80e01e039c6a tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.187988 May 27 15:21:07.326721 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 418/808] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:07 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:07.383845 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a80e2749-e702-4f9d-8a47-2e851f95b01e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:07.391853 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a80e2749-e702-4f9d-8a47-2e851f95b01e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:07.393341 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a80e2749-e702-4f9d-8a47-2e851f95b01e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:07.394513 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a80e2749-e702-4f9d-8a47-2e851f95b01e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1725 microversion: 2.20 time: 0.170868 May 27 15:21:07.395102 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 391/809] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:07 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:21:07.551859 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-adc04665-ffbf-4459-bade-ea677f435967 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "696304d2-ed7f-44ca-a43c-a93d20d438a4"}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:07.552904 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-adc04665-ffbf-4459-bade-ea677f435967 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:07.558947 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-adc04665-ffbf-4459-bade-ea677f435967 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:07.559392 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-adc04665-ffbf-4459-bade-ea677f435967 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:07.560140 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-adc04665-ffbf-4459-bade-ea677f435967 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:07.560571 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-adc04665-ffbf-4459-bade-ea677f435967 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:07.564108 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:08.343044 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-5426344d-4c9e-48c3-9648-fea8014111af tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:08.343662 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-5426344d-4c9e-48c3-9648-fea8014111af tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:08.350403 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5426344d-4c9e-48c3-9648-fea8014111af tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:08.350868 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5426344d-4c9e-48c3-9648-fea8014111af tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:08.352172 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5426344d-4c9e-48c3-9648-fea8014111af tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:08.352662 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5426344d-4c9e-48c3-9648-fea8014111af tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:08.499277 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-5426344d-4c9e-48c3-9648-fea8014111af tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:08.502842 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:08.507775 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-5426344d-4c9e-48c3-9648-fea8014111af tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.168576 May 27 15:21:08.508403 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 392/810] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:08 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:08.513134 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-25e8e84e-f97e-4fcf-abe9-139b93904640 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:08.513732 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-25e8e84e-f97e-4fcf-abe9-139b93904640 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:08.521331 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-25e8e84e-f97e-4fcf-abe9-139b93904640 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:08.521781 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-25e8e84e-f97e-4fcf-abe9-139b93904640 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:08.522549 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-25e8e84e-f97e-4fcf-abe9-139b93904640 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:08.523008 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-25e8e84e-f97e-4fcf-abe9-139b93904640 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:08.657273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-25e8e84e-f97e-4fcf-abe9-139b93904640 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:08.666146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-25e8e84e-f97e-4fcf-abe9-139b93904640 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:08.667689 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-25e8e84e-f97e-4fcf-abe9-139b93904640 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:08.668864 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-25e8e84e-f97e-4fcf-abe9-139b93904640 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1725 microversion: 2.20 time: 0.159451 May 27 15:21:08.669427 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 393/811] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:08 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:09.524974 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-2d812a77-738a-4689-b03d-4cf5255671b9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:09.525619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-2d812a77-738a-4689-b03d-4cf5255671b9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:09.532068 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2d812a77-738a-4689-b03d-4cf5255671b9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:09.532516 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2d812a77-738a-4689-b03d-4cf5255671b9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:09.533285 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2d812a77-738a-4689-b03d-4cf5255671b9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:09.533726 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2d812a77-738a-4689-b03d-4cf5255671b9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:09.675489 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-2d812a77-738a-4689-b03d-4cf5255671b9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:09.683529 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-2d812a77-738a-4689-b03d-4cf5255671b9 tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.162544 May 27 15:21:09.684091 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 394/812] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:09 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:09.688507 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-8199193f-bc56-414a-a9c9-cf9bf2afc3d8 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:09.689104 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-8199193f-bc56-414a-a9c9-cf9bf2afc3d8 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:09.694682 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8199193f-bc56-414a-a9c9-cf9bf2afc3d8 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:09.695187 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8199193f-bc56-414a-a9c9-cf9bf2afc3d8 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:09.696033 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8199193f-bc56-414a-a9c9-cf9bf2afc3d8 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:09.696469 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8199193f-bc56-414a-a9c9-cf9bf2afc3d8 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:09.823785 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-8199193f-bc56-414a-a9c9-cf9bf2afc3d8 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:09.831717 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-8199193f-bc56-414a-a9c9-cf9bf2afc3d8 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:09.833235 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-8199193f-bc56-414a-a9c9-cf9bf2afc3d8 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:09.834390 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-8199193f-bc56-414a-a9c9-cf9bf2afc3d8 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1725 microversion: 2.20 time: 0.149393 May 27 15:21:09.834979 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 395/813] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:09 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:10.700911 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-ff8a8b68-3845-4cfe-98dd-f5aafcba809d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:10.701546 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-ff8a8b68-3845-4cfe-98dd-f5aafcba809d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:10.708191 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ff8a8b68-3845-4cfe-98dd-f5aafcba809d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:10.708685 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ff8a8b68-3845-4cfe-98dd-f5aafcba809d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:10.709489 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ff8a8b68-3845-4cfe-98dd-f5aafcba809d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:10.709926 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ff8a8b68-3845-4cfe-98dd-f5aafcba809d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:10.847688 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-ff8a8b68-3845-4cfe-98dd-f5aafcba809d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:10.848336 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-adc04665-ffbf-4459-bade-ea677f435967 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "POST /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.300231 May 27 15:21:10.849505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 419/814] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 15:21:07 2022] POST /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-volume_attachments => generated 194 bytes in 3302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:10.855425 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-6b864a5e-cffc-4089-8c52-75d2a87d071e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:10.855981 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-ff8a8b68-3845-4cfe-98dd-f5aafcba809d tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1521 microversion: 2.1 time: 0.159038 May 27 15:21:10.856354 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-6b864a5e-cffc-4089-8c52-75d2a87d071e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:10.856555 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 396/815] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:10 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:10.872710 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6b864a5e-cffc-4089-8c52-75d2a87d071e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:10.873167 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6b864a5e-cffc-4089-8c52-75d2a87d071e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:10.873947 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6b864a5e-cffc-4089-8c52-75d2a87d071e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:10.874386 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6b864a5e-cffc-4089-8c52-75d2a87d071e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:11.014558 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6b864a5e-cffc-4089-8c52-75d2a87d071e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:11.022772 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6b864a5e-cffc-4089-8c52-75d2a87d071e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:11.024814 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6b864a5e-cffc-4089-8c52-75d2a87d071e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:11.026005 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-6b864a5e-cffc-4089-8c52-75d2a87d071e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1725 microversion: 2.20 time: 0.175426 May 27 15:21:11.034890 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 420/816] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:10 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:11.347184 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-6aa8dc85-caab-4659-a937-772514b660d6 req-968574e1-3641-4e91-821e-2f22ba90a2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c20afff-0f88-4fdf-9394-7025ab53044a", "name": "network-vif-deleted", "tag": "d270ca7e-e0f7-4348-8c7b-947e21204c89"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:11.356103 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-6aa8dc85-caab-4659-a937-772514b660d6 req-968574e1-3641-4e91-821e-2f22ba90a2c2 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:11.356532 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-6aa8dc85-caab-4659-a937-772514b660d6 req-968574e1-3641-4e91-821e-2f22ba90a2c2 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:11.367924 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-6aa8dc85-caab-4659-a937-772514b660d6 req-968574e1-3641-4e91-821e-2f22ba90a2c2 service nova] Creating event network-vif-deleted:d270ca7e-e0f7-4348-8c7b-947e21204c89 for instance 5c20afff-0f88-4fdf-9394-7025ab53044a on hv-cinder-84254 May 27 15:21:11.372556 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-6aa8dc85-caab-4659-a937-772514b660d6 req-968574e1-3641-4e91-821e-2f22ba90a2c2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029536 May 27 15:21:11.373454 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 397/817] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:11.872963 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-0263c2e2-8ad5-4485-a902-e7741cde88fd tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:11.873575 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-0263c2e2-8ad5-4485-a902-e7741cde88fd tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:11.880144 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0263c2e2-8ad5-4485-a902-e7741cde88fd tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:11.880592 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0263c2e2-8ad5-4485-a902-e7741cde88fd tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:11.881359 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0263c2e2-8ad5-4485-a902-e7741cde88fd tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:11.881808 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0263c2e2-8ad5-4485-a902-e7741cde88fd tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:11.913049 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0263c2e2-8ad5-4485-a902-e7741cde88fd tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:11.913501 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0263c2e2-8ad5-4485-a902-e7741cde88fd tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:11.914524 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.objects.instance [None req-0263c2e2-8ad5-4485-a902-e7741cde88fd tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lazy-loading 'fault' on Instance uuid 5c20afff-0f88-4fdf-9394-7025ab53044a {{(pid=117742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:21:11.959572 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-0263c2e2-8ad5-4485-a902-e7741cde88fd tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9149cb2b3c423796164b487a305bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c208c3d86c504ea086bf763e241cbc88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:11.976945 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-0263c2e2-8ad5-4485-a902-e7741cde88fd tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 200 len: 1312 microversion: 2.1 time: 0.099522 May 27 15:21:11.976945 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 421/818] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:11 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:12.044455 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-0bf1f88d-6fcf-434e-9b35-f34434efa713 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:12.045148 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-0bf1f88d-6fcf-434e-9b35-f34434efa713 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:12.051351 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0bf1f88d-6fcf-434e-9b35-f34434efa713 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:12.051821 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0bf1f88d-6fcf-434e-9b35-f34434efa713 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:12.052570 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0bf1f88d-6fcf-434e-9b35-f34434efa713 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:12.053011 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0bf1f88d-6fcf-434e-9b35-f34434efa713 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:12.181779 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-0bf1f88d-6fcf-434e-9b35-f34434efa713 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:12.189842 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-0bf1f88d-6fcf-434e-9b35-f34434efa713 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:12.191381 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-0bf1f88d-6fcf-434e-9b35-f34434efa713 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:12.192539 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-0bf1f88d-6fcf-434e-9b35-f34434efa713 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1725 microversion: 2.20 time: 0.152873 May 27 15:21:12.193096 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 398/819] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:12 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:12.985335 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-38bd964b-f84e-4110-9781-2dc191d76c6e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:12.985949 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-38bd964b-f84e-4110-9781-2dc191d76c6e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] [instance: 5c20afff-0f88-4fdf-9394-7025ab53044a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:12.993322 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-38bd964b-f84e-4110-9781-2dc191d76c6e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:12.993759 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-38bd964b-f84e-4110-9781-2dc191d76c6e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:12.994518 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-38bd964b-f84e-4110-9781-2dc191d76c6e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:12.994980 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-38bd964b-f84e-4110-9781-2dc191d76c6e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:13.008886 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-38bd964b-f84e-4110-9781-2dc191d76c6e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] HTTP exception thrown: Instance 5c20afff-0f88-4fdf-9394-7025ab53044a could not be found. May 27 15:21:13.010528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-38bd964b-f84e-4110-9781-2dc191d76c6e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Request method failure captured: May 27 15:21:13.010528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a HTTP/1.1 May 27 15:21:13.010528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:21:13.010528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:21:13.010528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:21:13.010528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:21:13.010528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:21:13.010528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:21:13.010528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:21:13.010528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:21:13.010528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOsskJv0Za1_r4uQKA_pi415_6wML-p1mRVGBWD8lWuud7bzAGolysbWk-OZBZUDOlh33cVz8_cStEJa1_A3rWwn3mlg65e6M9osS70eYm9HT9aGfMK1PAt0mA1rcJnxNqZvqN2lltoyozOfD_R1N4W67Q6b0UC8RqROVyLsQCTGw-I May 27 15:21:13.010528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:21:13.010528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:21:13.010528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:21:13.010528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:21:13.010528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:21:13.010528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:21:13.010528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: c208c3d86c504ea086bf763e241cbc88 May 27 15:21:13.010528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1899191250 May 27 15:21:13.010528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:21:13.010528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:21:13.012264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c208c3d86c504ea086bf763e241cbc88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c208c3d86c504ea086bf763e241cbc88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c208c3d86c504ea086bf763e241cbc88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c208c3d86c504ea086bf763e241cbc88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:21:13.012264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1899191250 May 27 15:21:13.012264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: c208c3d86c504ea086bf763e241cbc88 May 27 15:21:13.012264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1899191250 May 27 15:21:13.012264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-ServerRescueNegativeTestJSON-1899191250-project May 27 15:21:13.012264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:21:13.012264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:21:13.012264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 9c9149cb2b3c423796164b487a305bbd May 27 15:21:13.012264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1899191250-project May 27 15:21:13.012264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:21:13.012264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance 5c20afff-0f88-4fdf-9394-7025ab53044a could not be found. May 27 15:21:13.012264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': '5c20afff-0f88-4fdf-9394-7025ab53044a'} May 27 15:21:13.013718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:21:13.013718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:13.013718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:21:13.013718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:21:13.013718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:21:13.013718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:21:13.013718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:21:13.013718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:21:13.013718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:21:13.013718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:21:13.013718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c20afff-0f88-4fdf-9394-7025ab53044a could not be found. May 27 15:21:13.013718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:21:13.013718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:13.013718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:21:13.013718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:13.013718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:13.013718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:13.013718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:21:13.013718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:21:13.013718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:21:13.015136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:21:13.015136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:21:13.015136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:21:13.015136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:21:13.015136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:21:13.015136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:21:13.015136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:21:13.015136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c20afff-0f88-4fdf-9394-7025ab53044a could not be found. May 27 15:21:13.015136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:21:13.015136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:13.015136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:21:13.015136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:13.015136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:13.015136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:13.015136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:21:13.015136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:21:13.015136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c20afff-0f88-4fdf-9394-7025ab53044a could not be found. May 27 15:21:13.015136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:21:13.017227 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-38bd964b-f84e-4110-9781-2dc191d76c6e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] Returning 404 to user: Instance 5c20afff-0f88-4fdf-9394-7025ab53044a could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:21:13.017227 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-38bd964b-f84e-4110-9781-2dc191d76c6e tempest-ServerRescueNegativeTestJSON-1899191250 tempest-ServerRescueNegativeTestJSON-1899191250-project] 10.222.0.50 "GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a" status: 404 len: 111 microversion: 2.1 time: 0.030509 May 27 15:21:13.017227 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 422/820] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:12 2022] GET /compute/v2.1/servers/5c20afff-0f88-4fdf-9394-7025ab53044a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:21:13.211770 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b2b8e951-2050-45cd-a308-2938dbb517e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:13.212378 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b2b8e951-2050-45cd-a308-2938dbb517e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:13.218992 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b2b8e951-2050-45cd-a308-2938dbb517e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:13.219703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b2b8e951-2050-45cd-a308-2938dbb517e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:13.220469 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b2b8e951-2050-45cd-a308-2938dbb517e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:13.220911 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b2b8e951-2050-45cd-a308-2938dbb517e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:13.434657 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b2b8e951-2050-45cd-a308-2938dbb517e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:13.442721 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b2b8e951-2050-45cd-a308-2938dbb517e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:13.444335 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b2b8e951-2050-45cd-a308-2938dbb517e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:13.446027 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b2b8e951-2050-45cd-a308-2938dbb517e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1725 microversion: 2.20 time: 0.238683 May 27 15:21:13.446982 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 399/821] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:13 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1725 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:14.464803 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-4216f566-719a-424c-95f0-d04528ee0687 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:14.465398 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-4216f566-719a-424c-95f0-d04528ee0687 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:14.472125 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4216f566-719a-424c-95f0-d04528ee0687 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:14.472574 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4216f566-719a-424c-95f0-d04528ee0687 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:14.473332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4216f566-719a-424c-95f0-d04528ee0687 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:14.473759 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4216f566-719a-424c-95f0-d04528ee0687 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:14.613562 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-4216f566-719a-424c-95f0-d04528ee0687 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:14.622414 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-4216f566-719a-424c-95f0-d04528ee0687 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:14.623930 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-4216f566-719a-424c-95f0-d04528ee0687 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:14.625088 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-4216f566-719a-424c-95f0-d04528ee0687 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1725 microversion: 2.20 time: 0.164825 May 27 15:21:14.625949 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 423/822] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:14 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:15.644504 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-6ae6d4a8-db8c-4f94-bca1-5175da8bf83d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:15.645115 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-6ae6d4a8-db8c-4f94-bca1-5175da8bf83d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:15.652940 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6ae6d4a8-db8c-4f94-bca1-5175da8bf83d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:15.653396 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6ae6d4a8-db8c-4f94-bca1-5175da8bf83d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:15.654176 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6ae6d4a8-db8c-4f94-bca1-5175da8bf83d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:15.654611 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6ae6d4a8-db8c-4f94-bca1-5175da8bf83d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:15.797423 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-6ae6d4a8-db8c-4f94-bca1-5175da8bf83d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:15.810076 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-6ae6d4a8-db8c-4f94-bca1-5175da8bf83d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:15.812091 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-6ae6d4a8-db8c-4f94-bca1-5175da8bf83d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:15.813169 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-6ae6d4a8-db8c-4f94-bca1-5175da8bf83d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1725 microversion: 2.20 time: 0.172797 May 27 15:21:15.814911 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 400/823] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:15 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:16.832132 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-7676b702-528c-4e6e-b8d2-c36ff71402f3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:16.832679 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-7676b702-528c-4e6e-b8d2-c36ff71402f3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:16.839458 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7676b702-528c-4e6e-b8d2-c36ff71402f3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:16.839907 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7676b702-528c-4e6e-b8d2-c36ff71402f3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:16.840681 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7676b702-528c-4e6e-b8d2-c36ff71402f3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:16.841109 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7676b702-528c-4e6e-b8d2-c36ff71402f3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:16.973854 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-7676b702-528c-4e6e-b8d2-c36ff71402f3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:16.982529 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-7676b702-528c-4e6e-b8d2-c36ff71402f3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:16.984090 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-7676b702-528c-4e6e-b8d2-c36ff71402f3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:16.985271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-7676b702-528c-4e6e-b8d2-c36ff71402f3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1725 microversion: 2.20 time: 0.157204 May 27 15:21:16.985826 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 424/824] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:16 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:18.004820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-346f48e7-704a-4ab5-995a-1a7304de7981 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:18.005424 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-346f48e7-704a-4ab5-995a-1a7304de7981 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:18.016016 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-346f48e7-704a-4ab5-995a-1a7304de7981 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:18.016804 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-346f48e7-704a-4ab5-995a-1a7304de7981 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:18.017725 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-346f48e7-704a-4ab5-995a-1a7304de7981 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:18.018425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-346f48e7-704a-4ab5-995a-1a7304de7981 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:18.192560 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-346f48e7-704a-4ab5-995a-1a7304de7981 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:18.204115 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-346f48e7-704a-4ab5-995a-1a7304de7981 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:18.205042 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-346f48e7-704a-4ab5-995a-1a7304de7981 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:18.206621 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-346f48e7-704a-4ab5-995a-1a7304de7981 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1725 microversion: 2.20 time: 0.206348 May 27 15:21:18.207279 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 401/825] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:17 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:18.401158 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8f9a9ebb-4601-494d-b057-c2eb573b1434 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:18.401158 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-8f9a9ebb-4601-494d-b057-c2eb573b1434 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:18.406231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8f9a9ebb-4601-494d-b057-c2eb573b1434 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:18.406767 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8f9a9ebb-4601-494d-b057-c2eb573b1434 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:18.407666 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8f9a9ebb-4601-494d-b057-c2eb573b1434 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:18.408260 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8f9a9ebb-4601-494d-b057-c2eb573b1434 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:18.441784 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-8f9a9ebb-4601-494d-b057-c2eb573b1434 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048333 May 27 15:21:18.442516 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 425/826] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 15:21:18 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:18.453022 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a20b10d2-2cd6-42d8-bc4b-6aa61113f56e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:18.453510 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a20b10d2-2cd6-42d8-bc4b-6aa61113f56e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:18.461110 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a20b10d2-2cd6-42d8-bc4b-6aa61113f56e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:18.461110 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a20b10d2-2cd6-42d8-bc4b-6aa61113f56e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:18.461322 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a20b10d2-2cd6-42d8-bc4b-6aa61113f56e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:18.461664 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a20b10d2-2cd6-42d8-bc4b-6aa61113f56e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:18.495986 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a20b10d2-2cd6-42d8-bc4b-6aa61113f56e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-volume_attachments/696304d2-ed7f-44ca-a43c-a93d20d438a4" status: 200 len: 194 microversion: 2.1 time: 0.046849 May 27 15:21:18.500859 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 402/827] 10.222.0.50 () {58 vars in 1412 bytes} [Fri May 27 15:21:18 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-volume_attachments/696304d2-ed7f-44ca-a43c-a93d20d438a4 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:19.225610 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f37858db-b90c-42b4-b18a-1476cdc11ae5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:19.226756 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f37858db-b90c-42b4-b18a-1476cdc11ae5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:19.233530 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f37858db-b90c-42b4-b18a-1476cdc11ae5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:19.233980 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f37858db-b90c-42b4-b18a-1476cdc11ae5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:19.234906 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f37858db-b90c-42b4-b18a-1476cdc11ae5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:19.235360 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f37858db-b90c-42b4-b18a-1476cdc11ae5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:19.366670 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f37858db-b90c-42b4-b18a-1476cdc11ae5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:19.374936 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f37858db-b90c-42b4-b18a-1476cdc11ae5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:19.376479 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f37858db-b90c-42b4-b18a-1476cdc11ae5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:19.379592 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f37858db-b90c-42b4-b18a-1476cdc11ae5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1725 microversion: 2.20 time: 0.157863 May 27 15:21:19.380164 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 426/828] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:19 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:19.839705 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-76cd8c4f-13a0-4fe7-ae81-8beefe9b7f35 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1aad3eb5-58c2-4677-adfa-10f94654506f"}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:19.840759 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-76cd8c4f-13a0-4fe7-ae81-8beefe9b7f35 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:19.847537 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-76cd8c4f-13a0-4fe7-ae81-8beefe9b7f35 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:19.847990 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-76cd8c4f-13a0-4fe7-ae81-8beefe9b7f35 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:19.848748 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-76cd8c4f-13a0-4fe7-ae81-8beefe9b7f35 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:19.849180 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-76cd8c4f-13a0-4fe7-ae81-8beefe9b7f35 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:20.232640 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-76cd8c4f-13a0-4fe7-ae81-8beefe9b7f35 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "POST /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.396545 May 27 15:21:20.233548 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 403/829] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 15:21:19 2022] POST /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-volume_attachments => generated 194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:20.399717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-6529021e-b7fc-4be5-bdda-8492a7707fe4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:20.400332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-6529021e-b7fc-4be5-bdda-8492a7707fe4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:20.406742 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6529021e-b7fc-4be5-bdda-8492a7707fe4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:20.407249 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6529021e-b7fc-4be5-bdda-8492a7707fe4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:20.408016 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6529021e-b7fc-4be5-bdda-8492a7707fe4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:20.409152 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6529021e-b7fc-4be5-bdda-8492a7707fe4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:20.550753 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6529021e-b7fc-4be5-bdda-8492a7707fe4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:20.560554 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6529021e-b7fc-4be5-bdda-8492a7707fe4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:20.562343 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6529021e-b7fc-4be5-bdda-8492a7707fe4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:20.564063 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-6529021e-b7fc-4be5-bdda-8492a7707fe4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1746 microversion: 2.20 time: 0.169242 May 27 15:21:20.564899 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 427/830] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:20 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1746 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:20.623848 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-72085eaf-eea4-41a9-8100-fdc555d7d5cd tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:20.624475 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-72085eaf-eea4-41a9-8100-fdc555d7d5cd tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:20.630689 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-72085eaf-eea4-41a9-8100-fdc555d7d5cd tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:20.631196 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-72085eaf-eea4-41a9-8100-fdc555d7d5cd tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:20.631962 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-72085eaf-eea4-41a9-8100-fdc555d7d5cd tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:20.632442 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-72085eaf-eea4-41a9-8100-fdc555d7d5cd tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:20.655484 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.objects.instance [None req-72085eaf-eea4-41a9-8100-fdc555d7d5cd tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lazy-loading 'flavor' on Instance uuid 16e4355e-ea71-44c5-90ae-0ec0406a5d6e {{(pid=117743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:21:20.733720 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-72085eaf-eea4-41a9-8100-fdc555d7d5cd tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "POST /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e/action" status: 202 len: 0 microversion: 2.1 time: 0.114133 May 27 15:21:20.734348 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 404/831] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 15:21:20 2022] POST /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:21:20.744644 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-19dc3e87-7e59-4e48-8ce6-ffabdaad52a3 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:20.745275 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-19dc3e87-7e59-4e48-8ce6-ffabdaad52a3 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:20.752266 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-19dc3e87-7e59-4e48-8ce6-ffabdaad52a3 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:20.753067 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-19dc3e87-7e59-4e48-8ce6-ffabdaad52a3 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:20.753869 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-19dc3e87-7e59-4e48-8ce6-ffabdaad52a3 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:20.754397 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-19dc3e87-7e59-4e48-8ce6-ffabdaad52a3 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:20.900098 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-19dc3e87-7e59-4e48-8ce6-ffabdaad52a3 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:20.907857 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-19dc3e87-7e59-4e48-8ce6-ffabdaad52a3 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1569 microversion: 2.1 time: 0.168234 May 27 15:21:20.908490 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 428/832] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:20 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:21.586630 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-4009fe36-b5d7-4145-8bd8-9545c2f245aa tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:21.587512 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-4009fe36-b5d7-4145-8bd8-9545c2f245aa tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:21.595557 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4009fe36-b5d7-4145-8bd8-9545c2f245aa tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:21.596020 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4009fe36-b5d7-4145-8bd8-9545c2f245aa tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:21.596802 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4009fe36-b5d7-4145-8bd8-9545c2f245aa tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:21.597243 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4009fe36-b5d7-4145-8bd8-9545c2f245aa tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:21.735270 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-4009fe36-b5d7-4145-8bd8-9545c2f245aa tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:21.744271 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-4009fe36-b5d7-4145-8bd8-9545c2f245aa tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:21.745780 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-4009fe36-b5d7-4145-8bd8-9545c2f245aa tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:21.746954 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-4009fe36-b5d7-4145-8bd8-9545c2f245aa tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1746 microversion: 2.20 time: 0.166461 May 27 15:21:21.747567 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 405/833] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:21 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1746 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:21.925512 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-584acf19-f3e5-4198-ade2-ad9b73802056 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:21.926126 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-584acf19-f3e5-4198-ade2-ad9b73802056 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:21.933592 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-584acf19-f3e5-4198-ade2-ad9b73802056 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:21.934048 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-584acf19-f3e5-4198-ade2-ad9b73802056 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:21.934819 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-584acf19-f3e5-4198-ade2-ad9b73802056 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:21.935276 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-584acf19-f3e5-4198-ade2-ad9b73802056 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:22.091334 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-584acf19-f3e5-4198-ade2-ad9b73802056 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:22.099377 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-584acf19-f3e5-4198-ade2-ad9b73802056 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1569 microversion: 2.1 time: 0.177695 May 27 15:21:22.099954 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 429/834] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:21 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:22.766722 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-4e236113-cce7-4ad7-8422-d67a2e01dfb1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:22.768059 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-4e236113-cce7-4ad7-8422-d67a2e01dfb1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:22.772442 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:22.778314 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4e236113-cce7-4ad7-8422-d67a2e01dfb1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:22.778889 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4e236113-cce7-4ad7-8422-d67a2e01dfb1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:22.779733 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4e236113-cce7-4ad7-8422-d67a2e01dfb1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:22.780181 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4e236113-cce7-4ad7-8422-d67a2e01dfb1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:22.922793 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-4e236113-cce7-4ad7-8422-d67a2e01dfb1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:22.927213 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:22.935711 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-4e236113-cce7-4ad7-8422-d67a2e01dfb1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:22.937332 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-4e236113-cce7-4ad7-8422-d67a2e01dfb1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:22.938615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-4e236113-cce7-4ad7-8422-d67a2e01dfb1 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1741 microversion: 2.20 time: 0.176811 May 27 15:21:22.939393 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 406/835] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:22 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:23.120263 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-71f3c988-8074-45ae-b88e-28cecad2826e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:23.120798 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-71f3c988-8074-45ae-b88e-28cecad2826e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:23.128088 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-71f3c988-8074-45ae-b88e-28cecad2826e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:23.128811 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-71f3c988-8074-45ae-b88e-28cecad2826e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:23.129864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-71f3c988-8074-45ae-b88e-28cecad2826e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:23.130317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-71f3c988-8074-45ae-b88e-28cecad2826e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:23.382228 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-71f3c988-8074-45ae-b88e-28cecad2826e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:23.391117 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-71f3c988-8074-45ae-b88e-28cecad2826e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1569 microversion: 2.1 time: 0.275938 May 27 15:21:23.391934 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 430/836] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:23 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1569 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:23.957660 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-3a6caedf-5d92-46f1-acf6-3a9fabe414b5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:23.958248 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-3a6caedf-5d92-46f1-acf6-3a9fabe414b5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:23.965838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3a6caedf-5d92-46f1-acf6-3a9fabe414b5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:23.966489 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3a6caedf-5d92-46f1-acf6-3a9fabe414b5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:23.967453 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3a6caedf-5d92-46f1-acf6-3a9fabe414b5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:23.968071 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-3a6caedf-5d92-46f1-acf6-3a9fabe414b5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:24.168717 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-3a6caedf-5d92-46f1-acf6-3a9fabe414b5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:24.181761 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-3a6caedf-5d92-46f1-acf6-3a9fabe414b5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:24.183883 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-3a6caedf-5d92-46f1-acf6-3a9fabe414b5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:24.186878 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-3a6caedf-5d92-46f1-acf6-3a9fabe414b5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1741 microversion: 2.20 time: 0.233106 May 27 15:21:24.190297 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 407/837] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:23 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1741 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:24.410091 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-0928c385-939b-4ee1-ab1b-cd37e5f60205 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:24.412035 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-0928c385-939b-4ee1-ab1b-cd37e5f60205 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:24.419495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0928c385-939b-4ee1-ab1b-cd37e5f60205 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:24.420169 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0928c385-939b-4ee1-ab1b-cd37e5f60205 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:24.420939 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0928c385-939b-4ee1-ab1b-cd37e5f60205 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:24.421528 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0928c385-939b-4ee1-ab1b-cd37e5f60205 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:24.638609 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-0928c385-939b-4ee1-ab1b-cd37e5f60205 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:24.647788 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-0928c385-939b-4ee1-ab1b-cd37e5f60205 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1569 microversion: 2.1 time: 0.243533 May 27 15:21:24.648973 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 431/838] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:24 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1569 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:25.209900 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a5cb4400-57ed-4e8a-9ae6-1eda443cc0a5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:25.211023 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a5cb4400-57ed-4e8a-9ae6-1eda443cc0a5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:25.228114 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a5cb4400-57ed-4e8a-9ae6-1eda443cc0a5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:25.228656 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a5cb4400-57ed-4e8a-9ae6-1eda443cc0a5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:25.229749 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a5cb4400-57ed-4e8a-9ae6-1eda443cc0a5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:25.230250 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a5cb4400-57ed-4e8a-9ae6-1eda443cc0a5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:25.425960 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a5cb4400-57ed-4e8a-9ae6-1eda443cc0a5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:25.442558 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a5cb4400-57ed-4e8a-9ae6-1eda443cc0a5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:25.446396 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a5cb4400-57ed-4e8a-9ae6-1eda443cc0a5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:25.449618 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a5cb4400-57ed-4e8a-9ae6-1eda443cc0a5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1741 microversion: 2.20 time: 0.243829 May 27 15:21:25.450698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 408/839] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:25 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1741 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:25.666057 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-cf448049-3d3e-4f7d-9d53-672e2ed41521 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:25.667629 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-cf448049-3d3e-4f7d-9d53-672e2ed41521 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:25.675724 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-cf448049-3d3e-4f7d-9d53-672e2ed41521 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:25.676416 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-cf448049-3d3e-4f7d-9d53-672e2ed41521 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:25.677658 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-cf448049-3d3e-4f7d-9d53-672e2ed41521 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:25.678480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-cf448049-3d3e-4f7d-9d53-672e2ed41521 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:25.940079 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-cf448049-3d3e-4f7d-9d53-672e2ed41521 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:25.952160 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-cf448049-3d3e-4f7d-9d53-672e2ed41521 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1569 microversion: 2.1 time: 0.289950 May 27 15:21:25.952752 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 432/840] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:25 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1569 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:25.976659 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-ffdb5e1e-23aa-4dad-980c-bb69e05ca932 req-637a3a3f-ce05-4ef7-b6e3-fa3e9e2ec8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1c52039-f595-4f22-9df9-ea3a999f55fe", "name": "network-vif-plugged", "status": "completed", "tag": "00ae88d7-8fbc-40d5-aefb-819837b95c30"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:25.997435 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-ffdb5e1e-23aa-4dad-980c-bb69e05ca932 req-637a3a3f-ce05-4ef7-b6e3-fa3e9e2ec8a2 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:25.999694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-ffdb5e1e-23aa-4dad-980c-bb69e05ca932 req-637a3a3f-ce05-4ef7-b6e3-fa3e9e2ec8a2 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:26.019326 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-ffdb5e1e-23aa-4dad-980c-bb69e05ca932 req-637a3a3f-ce05-4ef7-b6e3-fa3e9e2ec8a2 service nova] Creating event network-vif-plugged:00ae88d7-8fbc-40d5-aefb-819837b95c30 for instance f1c52039-f595-4f22-9df9-ea3a999f55fe on hv-cinder-84254 May 27 15:21:26.025070 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-ffdb5e1e-23aa-4dad-980c-bb69e05ca932 req-637a3a3f-ce05-4ef7-b6e3-fa3e9e2ec8a2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052471 May 27 15:21:26.026200 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 409/841] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:21:26.470929 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-909f9c34-b68c-4832-8edc-f0432d887dc6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:26.471957 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-909f9c34-b68c-4832-8edc-f0432d887dc6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:26.478130 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-909f9c34-b68c-4832-8edc-f0432d887dc6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:26.478580 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-909f9c34-b68c-4832-8edc-f0432d887dc6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:26.479393 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-909f9c34-b68c-4832-8edc-f0432d887dc6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:26.479828 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-909f9c34-b68c-4832-8edc-f0432d887dc6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:26.723445 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-909f9c34-b68c-4832-8edc-f0432d887dc6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:26.737392 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-909f9c34-b68c-4832-8edc-f0432d887dc6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:26.739709 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-909f9c34-b68c-4832-8edc-f0432d887dc6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:26.742035 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-909f9c34-b68c-4832-8edc-f0432d887dc6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1741 microversion: 2.20 time: 0.275169 May 27 15:21:26.742763 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 433/842] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:26 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1741 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:26.979392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-7b541786-5531-470a-bf34-6f8aee4be06b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:26.982303 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-7b541786-5531-470a-bf34-6f8aee4be06b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:27.007359 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-7b541786-5531-470a-bf34-6f8aee4be06b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:27.010920 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-7b541786-5531-470a-bf34-6f8aee4be06b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:27.021722 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-7b541786-5531-470a-bf34-6f8aee4be06b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:27.022476 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-7b541786-5531-470a-bf34-6f8aee4be06b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:27.264655 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-7b541786-5531-470a-bf34-6f8aee4be06b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:27.274201 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-7b541786-5531-470a-bf34-6f8aee4be06b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1569 microversion: 2.1 time: 0.308387 May 27 15:21:27.274785 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 410/843] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:26 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1569 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:27.761497 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f418f7d9-1217-4b47-bc4e-9576c78acbf4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:27.762416 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f418f7d9-1217-4b47-bc4e-9576c78acbf4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:27.772273 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f418f7d9-1217-4b47-bc4e-9576c78acbf4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:27.773551 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f418f7d9-1217-4b47-bc4e-9576c78acbf4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:27.774457 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f418f7d9-1217-4b47-bc4e-9576c78acbf4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:27.775036 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f418f7d9-1217-4b47-bc4e-9576c78acbf4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:27.908397 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-07c0d9e5-c44e-4f9c-a1c3-2d8804bf9a38 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:27.909698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-07c0d9e5-c44e-4f9c-a1c3-2d8804bf9a38 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:27.916347 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-07c0d9e5-c44e-4f9c-a1c3-2d8804bf9a38 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:27.917077 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-07c0d9e5-c44e-4f9c-a1c3-2d8804bf9a38 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:27.918085 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-07c0d9e5-c44e-4f9c-a1c3-2d8804bf9a38 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:27.918703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-07c0d9e5-c44e-4f9c-a1c3-2d8804bf9a38 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:27.950109 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-07c0d9e5-c44e-4f9c-a1c3-2d8804bf9a38 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045758 May 27 15:21:27.954895 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 411/844] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 15:21:27 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:21:27.955040 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f418f7d9-1217-4b47-bc4e-9576c78acbf4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:27.957319 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:27.966047 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f418f7d9-1217-4b47-bc4e-9576c78acbf4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:27.968265 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f418f7d9-1217-4b47-bc4e-9576c78acbf4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:27.969929 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f418f7d9-1217-4b47-bc4e-9576c78acbf4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1741 microversion: 2.20 time: 0.213564 May 27 15:21:27.970565 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 434/845] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:27 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1741 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:21:28.095203 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-7352ef49-dfc5-4e2e-bb4e-6b257093ef38 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:28.096331 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-7352ef49-dfc5-4e2e-bb4e-6b257093ef38 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:28.103679 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-7352ef49-dfc5-4e2e-bb4e-6b257093ef38 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:28.104355 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-7352ef49-dfc5-4e2e-bb4e-6b257093ef38 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:28.105294 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-7352ef49-dfc5-4e2e-bb4e-6b257093ef38 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:28.105755 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-7352ef49-dfc5-4e2e-bb4e-6b257093ef38 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:28.140727 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-7352ef49-dfc5-4e2e-bb4e-6b257093ef38 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-volume_attachments/696304d2-ed7f-44ca-a43c-a93d20d438a4" status: 200 len: 194 microversion: 2.1 time: 0.049995 May 27 15:21:28.141326 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 412/846] 10.222.0.50 () {58 vars in 1412 bytes} [Fri May 27 15:21:28 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-volume_attachments/696304d2-ed7f-44ca-a43c-a93d20d438a4 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:28.151960 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-452ce4bd-70e8-4d6c-999c-18aa100c8e7b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:28.152998 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-452ce4bd-70e8-4d6c-999c-18aa100c8e7b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:28.165248 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-452ce4bd-70e8-4d6c-999c-18aa100c8e7b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:28.165932 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-452ce4bd-70e8-4d6c-999c-18aa100c8e7b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:28.166872 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-452ce4bd-70e8-4d6c-999c-18aa100c8e7b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:28.167454 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-452ce4bd-70e8-4d6c-999c-18aa100c8e7b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:28.262014 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.objects.instance [None req-452ce4bd-70e8-4d6c-999c-18aa100c8e7b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lazy-loading 'services' on Instance uuid fe4a7119-2de1-4f92-a310-bdd2eb2aa316 {{(pid=117742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:21:28.294326 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-1d16b5d0-45b4-4a79-93ac-bf994fcb8560 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:28.295325 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-1d16b5d0-45b4-4a79-93ac-bf994fcb8560 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:28.302052 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1d16b5d0-45b4-4a79-93ac-bf994fcb8560 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:28.303026 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1d16b5d0-45b4-4a79-93ac-bf994fcb8560 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:28.305130 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1d16b5d0-45b4-4a79-93ac-bf994fcb8560 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:28.306080 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1d16b5d0-45b4-4a79-93ac-bf994fcb8560 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:28.343487 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-452ce4bd-70e8-4d6c-999c-18aa100c8e7b tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-volume_attachments/696304d2-ed7f-44ca-a43c-a93d20d438a4" status: 202 len: 0 microversion: 2.1 time: 0.195509 May 27 15:21:28.345078 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 435/847] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 15:21:28 2022] DELETE /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-volume_attachments/696304d2-ed7f-44ca-a43c-a93d20d438a4 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:21:28.489031 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-1d16b5d0-45b4-4a79-93ac-bf994fcb8560 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:28.498287 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-1d16b5d0-45b4-4a79-93ac-bf994fcb8560 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1569 microversion: 2.1 time: 0.210729 May 27 15:21:28.499156 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 413/848] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:28 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:28.989392 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-78a864fc-1872-4a13-9d4c-b5ecb0bad3e0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:28.990094 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-78a864fc-1872-4a13-9d4c-b5ecb0bad3e0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:28.998118 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-78a864fc-1872-4a13-9d4c-b5ecb0bad3e0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:28.998817 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-78a864fc-1872-4a13-9d4c-b5ecb0bad3e0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:28.999615 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-78a864fc-1872-4a13-9d4c-b5ecb0bad3e0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:29.000474 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-78a864fc-1872-4a13-9d4c-b5ecb0bad3e0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:29.179928 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-78a864fc-1872-4a13-9d4c-b5ecb0bad3e0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:29.193128 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-78a864fc-1872-4a13-9d4c-b5ecb0bad3e0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:29.196206 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-78a864fc-1872-4a13-9d4c-b5ecb0bad3e0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:29.197670 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-78a864fc-1872-4a13-9d4c-b5ecb0bad3e0 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1741 microversion: 2.20 time: 0.212799 May 27 15:21:29.198690 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 436/849] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:28 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1741 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:29.516092 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-137b81cd-501d-4ef5-9f63-e20c92349dd8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:29.516914 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-137b81cd-501d-4ef5-9f63-e20c92349dd8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:29.526646 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-137b81cd-501d-4ef5-9f63-e20c92349dd8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:29.527555 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-137b81cd-501d-4ef5-9f63-e20c92349dd8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:29.528983 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-137b81cd-501d-4ef5-9f63-e20c92349dd8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:29.528983 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-137b81cd-501d-4ef5-9f63-e20c92349dd8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:29.688591 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-137b81cd-501d-4ef5-9f63-e20c92349dd8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:29.698193 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-137b81cd-501d-4ef5-9f63-e20c92349dd8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1569 microversion: 2.1 time: 0.186252 May 27 15:21:29.698881 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 414/850] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:29 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:30.217633 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-1c1462f3-c42c-4cd8-a92e-c77001760bc5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:30.222402 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-1c1462f3-c42c-4cd8-a92e-c77001760bc5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:30.231836 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1c1462f3-c42c-4cd8-a92e-c77001760bc5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:30.232847 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1c1462f3-c42c-4cd8-a92e-c77001760bc5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:30.234744 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1c1462f3-c42c-4cd8-a92e-c77001760bc5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:30.238205 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1c1462f3-c42c-4cd8-a92e-c77001760bc5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:30.391761 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-1c1462f3-c42c-4cd8-a92e-c77001760bc5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:30.414820 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-1c1462f3-c42c-4cd8-a92e-c77001760bc5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:30.419391 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-1c1462f3-c42c-4cd8-a92e-c77001760bc5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:30.421555 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-1c1462f3-c42c-4cd8-a92e-c77001760bc5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1741 microversion: 2.20 time: 0.208128 May 27 15:21:30.422983 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 437/851] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:30 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1741 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:30.552971 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-8513944d-3fff-4c90-a8e1-52663fc74f84 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:30.554121 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-8513944d-3fff-4c90-a8e1-52663fc74f84 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:30.561313 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8513944d-3fff-4c90-a8e1-52663fc74f84 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:30.562011 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8513944d-3fff-4c90-a8e1-52663fc74f84 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:30.562971 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8513944d-3fff-4c90-a8e1-52663fc74f84 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:30.563616 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8513944d-3fff-4c90-a8e1-52663fc74f84 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:30.602065 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-8513944d-3fff-4c90-a8e1-52663fc74f84 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-volume_attachments/1aad3eb5-58c2-4677-adfa-10f94654506f" status: 200 len: 194 microversion: 2.1 time: 0.053736 May 27 15:21:30.603189 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 415/852] 10.222.0.50 () {58 vars in 1412 bytes} [Fri May 27 15:21:30 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-volume_attachments/1aad3eb5-58c2-4677-adfa-10f94654506f => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:30.613502 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-22ec5769-8d45-4540-b44f-54278b1f609e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:30.614038 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-22ec5769-8d45-4540-b44f-54278b1f609e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:30.620449 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-22ec5769-8d45-4540-b44f-54278b1f609e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:30.621161 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-22ec5769-8d45-4540-b44f-54278b1f609e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:30.621936 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-22ec5769-8d45-4540-b44f-54278b1f609e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:30.622480 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-22ec5769-8d45-4540-b44f-54278b1f609e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:30.711505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.objects.instance [None req-22ec5769-8d45-4540-b44f-54278b1f609e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lazy-loading 'services' on Instance uuid fe4a7119-2de1-4f92-a310-bdd2eb2aa316 {{(pid=117742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:21:30.715488 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-14e30d18-86da-4f1d-b0d1-327f46176262 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:30.716272 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-14e30d18-86da-4f1d-b0d1-327f46176262 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:30.723409 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-14e30d18-86da-4f1d-b0d1-327f46176262 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:30.723988 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-14e30d18-86da-4f1d-b0d1-327f46176262 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:30.724871 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-14e30d18-86da-4f1d-b0d1-327f46176262 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:30.725414 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-14e30d18-86da-4f1d-b0d1-327f46176262 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:30.794337 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-22ec5769-8d45-4540-b44f-54278b1f609e tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-volume_attachments/1aad3eb5-58c2-4677-adfa-10f94654506f" status: 202 len: 0 microversion: 2.1 time: 0.185282 May 27 15:21:30.798679 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 438/853] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 15:21:30 2022] DELETE /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-volume_attachments/1aad3eb5-58c2-4677-adfa-10f94654506f => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:21:30.918709 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-14e30d18-86da-4f1d-b0d1-327f46176262 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:30.927447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-14e30d18-86da-4f1d-b0d1-327f46176262 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1569 microversion: 2.1 time: 0.215795 May 27 15:21:30.939105 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 416/854] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:30 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1569 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:31.441665 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-2519ba35-ebf3-4de0-8b15-38920bc2c3fe tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:31.442987 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-2519ba35-ebf3-4de0-8b15-38920bc2c3fe tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:31.472863 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2519ba35-ebf3-4de0-8b15-38920bc2c3fe tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:31.473707 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2519ba35-ebf3-4de0-8b15-38920bc2c3fe tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:31.474748 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2519ba35-ebf3-4de0-8b15-38920bc2c3fe tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:31.476823 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2519ba35-ebf3-4de0-8b15-38920bc2c3fe tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:31.674804 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-2519ba35-ebf3-4de0-8b15-38920bc2c3fe tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:31.683685 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-2519ba35-ebf3-4de0-8b15-38920bc2c3fe tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:31.685525 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-2519ba35-ebf3-4de0-8b15-38920bc2c3fe tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:31.686953 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-2519ba35-ebf3-4de0-8b15-38920bc2c3fe tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1741 microversion: 2.20 time: 0.250172 May 27 15:21:31.687714 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 439/855] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:31 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1741 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:31.946747 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-bd927ec8-c67f-415a-9284-fe64070ed222 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:31.948152 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-bd927ec8-c67f-415a-9284-fe64070ed222 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:31.963909 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bd927ec8-c67f-415a-9284-fe64070ed222 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:31.964625 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bd927ec8-c67f-415a-9284-fe64070ed222 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:31.967144 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bd927ec8-c67f-415a-9284-fe64070ed222 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:31.968797 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bd927ec8-c67f-415a-9284-fe64070ed222 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:32.141404 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-bd927ec8-c67f-415a-9284-fe64070ed222 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:32.162390 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-bd927ec8-c67f-415a-9284-fe64070ed222 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1569 microversion: 2.1 time: 0.220524 May 27 15:21:32.164001 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 417/856] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:31 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:32.707801 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-c84a4082-5549-4048-957e-34f60bd4e7e7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:32.708629 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-c84a4082-5549-4048-957e-34f60bd4e7e7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:32.715590 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c84a4082-5549-4048-957e-34f60bd4e7e7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:32.716239 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c84a4082-5549-4048-957e-34f60bd4e7e7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:32.717214 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c84a4082-5549-4048-957e-34f60bd4e7e7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:32.717648 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c84a4082-5549-4048-957e-34f60bd4e7e7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:33.141950 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-c84a4082-5549-4048-957e-34f60bd4e7e7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:33.156971 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-c84a4082-5549-4048-957e-34f60bd4e7e7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:33.158544 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-c84a4082-5549-4048-957e-34f60bd4e7e7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:33.159713 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-c84a4082-5549-4048-957e-34f60bd4e7e7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1741 microversion: 2.20 time: 0.457719 May 27 15:21:33.170738 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 440/857] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:32 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1741 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:33.181344 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-16134c77-967a-4d2a-b4fc-c5cd3d872c11 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:33.182059 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-16134c77-967a-4d2a-b4fc-c5cd3d872c11 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:33.195560 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-16134c77-967a-4d2a-b4fc-c5cd3d872c11 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:33.215903 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-16134c77-967a-4d2a-b4fc-c5cd3d872c11 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:33.216963 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-16134c77-967a-4d2a-b4fc-c5cd3d872c11 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:33.217815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-21a5c016-367a-4b83-938a-309b30393cb9 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:33.218218 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-16134c77-967a-4d2a-b4fc-c5cd3d872c11 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:33.219705 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-21a5c016-367a-4b83-938a-309b30393cb9 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:33.232330 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-21a5c016-367a-4b83-938a-309b30393cb9 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:33.232788 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-21a5c016-367a-4b83-938a-309b30393cb9 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:33.233599 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-21a5c016-367a-4b83-938a-309b30393cb9 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:33.234062 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-21a5c016-367a-4b83-938a-309b30393cb9 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:33.277500 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-21a5c016-367a-4b83-938a-309b30393cb9 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068640 May 27 15:21:33.279357 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 441/858] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 15:21:33 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:21:33.469605 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-16134c77-967a-4d2a-b4fc-c5cd3d872c11 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:33.478556 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-16134c77-967a-4d2a-b4fc-c5cd3d872c11 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1569 microversion: 2.1 time: 0.302139 May 27 15:21:33.483432 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 418/859] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:33 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1569 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:33.488926 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f3255966-ee44-492a-b924-4ee5aefa2083 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:33.490026 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f3255966-ee44-492a-b924-4ee5aefa2083 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:33.496952 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f3255966-ee44-492a-b924-4ee5aefa2083 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:33.497556 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f3255966-ee44-492a-b924-4ee5aefa2083 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:33.498395 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f3255966-ee44-492a-b924-4ee5aefa2083 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:33.498831 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f3255966-ee44-492a-b924-4ee5aefa2083 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:33.529016 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f3255966-ee44-492a-b924-4ee5aefa2083 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044592 May 27 15:21:33.529685 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 442/860] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 15:21:33 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 15:21:33.591001 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-ab80b0ff-1046-4560-9e34-6154396194b1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:33.591543 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-ab80b0ff-1046-4560-9e34-6154396194b1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:33.597901 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ab80b0ff-1046-4560-9e34-6154396194b1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:33.598350 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ab80b0ff-1046-4560-9e34-6154396194b1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:33.599141 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ab80b0ff-1046-4560-9e34-6154396194b1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:33.599576 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ab80b0ff-1046-4560-9e34-6154396194b1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:33.625621 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-ab80b0ff-1046-4560-9e34-6154396194b1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Going to try to terminate instance {{(pid=117743) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:21:33.701194 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-ab80b0ff-1046-4560-9e34-6154396194b1 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 204 len: 0 microversion: 2.1 time: 0.113799 May 27 15:21:33.701722 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 419/861] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:21:33 2022] DELETE /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 15:21:33.710617 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-3862dc4b-c3ae-4de8-a6a0-425b67d5008c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:33.711289 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-3862dc4b-c3ae-4de8-a6a0-425b67d5008c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:33.718021 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3862dc4b-c3ae-4de8-a6a0-425b67d5008c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:33.718484 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3862dc4b-c3ae-4de8-a6a0-425b67d5008c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:33.719516 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3862dc4b-c3ae-4de8-a6a0-425b67d5008c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:33.719954 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3862dc4b-c3ae-4de8-a6a0-425b67d5008c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:33.852044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-3862dc4b-c3ae-4de8-a6a0-425b67d5008c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:33.859555 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-3862dc4b-c3ae-4de8-a6a0-425b67d5008c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1674 microversion: 2.1 time: 0.153493 May 27 15:21:33.860136 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 443/862] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:33 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:34.178149 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-031dc62a-ffdf-4a54-a6b2-0fb2f0f80767 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:34.179357 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-031dc62a-ffdf-4a54-a6b2-0fb2f0f80767 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:34.185984 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-031dc62a-ffdf-4a54-a6b2-0fb2f0f80767 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:34.186527 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-031dc62a-ffdf-4a54-a6b2-0fb2f0f80767 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:34.187213 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-031dc62a-ffdf-4a54-a6b2-0fb2f0f80767 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:34.187655 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-031dc62a-ffdf-4a54-a6b2-0fb2f0f80767 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:34.316585 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-031dc62a-ffdf-4a54-a6b2-0fb2f0f80767 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:34.325704 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-031dc62a-ffdf-4a54-a6b2-0fb2f0f80767 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:34.327310 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-031dc62a-ffdf-4a54-a6b2-0fb2f0f80767 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:34.328467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-031dc62a-ffdf-4a54-a6b2-0fb2f0f80767 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1723 microversion: 2.20 time: 0.154691 May 27 15:21:34.329032 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 420/863] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:34 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:34.496593 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f5e8cfbe-82be-4048-b55f-a8a517cc8aa8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:34.497209 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f5e8cfbe-82be-4048-b55f-a8a517cc8aa8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:34.503733 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f5e8cfbe-82be-4048-b55f-a8a517cc8aa8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:34.504188 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f5e8cfbe-82be-4048-b55f-a8a517cc8aa8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:34.505110 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f5e8cfbe-82be-4048-b55f-a8a517cc8aa8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:34.505554 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f5e8cfbe-82be-4048-b55f-a8a517cc8aa8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:34.650119 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f5e8cfbe-82be-4048-b55f-a8a517cc8aa8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:34.657978 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f5e8cfbe-82be-4048-b55f-a8a517cc8aa8 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1569 microversion: 2.1 time: 0.165295 May 27 15:21:34.658603 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 444/864] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:34 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:34.878173 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-0c0dbd49-e172-4214-bc43-3633b3a2507c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:34.878785 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-0c0dbd49-e172-4214-bc43-3633b3a2507c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:34.885123 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0c0dbd49-e172-4214-bc43-3633b3a2507c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:34.885588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0c0dbd49-e172-4214-bc43-3633b3a2507c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:34.886415 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0c0dbd49-e172-4214-bc43-3633b3a2507c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:34.886877 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0c0dbd49-e172-4214-bc43-3633b3a2507c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:35.037899 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-0c0dbd49-e172-4214-bc43-3633b3a2507c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:35.046244 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-0c0dbd49-e172-4214-bc43-3633b3a2507c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1674 microversion: 2.1 time: 0.172095 May 27 15:21:35.046811 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 421/865] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:34 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:35.347275 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-30de47c2-b003-4a80-8e41-2c4b08e1d839 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:35.347885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-30de47c2-b003-4a80-8e41-2c4b08e1d839 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:35.354415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-30de47c2-b003-4a80-8e41-2c4b08e1d839 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:35.354892 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-30de47c2-b003-4a80-8e41-2c4b08e1d839 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:35.355666 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-30de47c2-b003-4a80-8e41-2c4b08e1d839 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:35.356102 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-30de47c2-b003-4a80-8e41-2c4b08e1d839 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:35.486269 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-30de47c2-b003-4a80-8e41-2c4b08e1d839 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:35.494436 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-30de47c2-b003-4a80-8e41-2c4b08e1d839 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:35.495979 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-30de47c2-b003-4a80-8e41-2c4b08e1d839 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:35.497143 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-30de47c2-b003-4a80-8e41-2c4b08e1d839 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1723 microversion: 2.20 time: 0.154134 May 27 15:21:35.497696 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 445/866] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:35 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:35.676397 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-01f324af-0f1a-4a80-a95f-d8109c76f0a6 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:35.676933 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-01f324af-0f1a-4a80-a95f-d8109c76f0a6 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:35.684339 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-01f324af-0f1a-4a80-a95f-d8109c76f0a6 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:35.684782 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-01f324af-0f1a-4a80-a95f-d8109c76f0a6 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:35.685563 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-01f324af-0f1a-4a80-a95f-d8109c76f0a6 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:35.685991 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-01f324af-0f1a-4a80-a95f-d8109c76f0a6 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:35.704578 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:35.821409 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-01f324af-0f1a-4a80-a95f-d8109c76f0a6 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:35.831258 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-01f324af-0f1a-4a80-a95f-d8109c76f0a6 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1569 microversion: 2.1 time: 0.158723 May 27 15:21:35.832127 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 422/867] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:35 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:36.063523 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-9672df9a-1fcf-42fb-a056-7d21d2d11f7c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:36.064140 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-9672df9a-1fcf-42fb-a056-7d21d2d11f7c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:36.070368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9672df9a-1fcf-42fb-a056-7d21d2d11f7c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:36.070814 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9672df9a-1fcf-42fb-a056-7d21d2d11f7c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:36.071642 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9672df9a-1fcf-42fb-a056-7d21d2d11f7c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:36.072077 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9672df9a-1fcf-42fb-a056-7d21d2d11f7c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:36.206891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-9672df9a-1fcf-42fb-a056-7d21d2d11f7c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:36.214537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-9672df9a-1fcf-42fb-a056-7d21d2d11f7c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1674 microversion: 2.1 time: 0.154862 May 27 15:21:36.215161 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 446/868] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:36 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:36.516043 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-036e15c3-d037-478d-9641-180fe0a6e897 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:36.516758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-036e15c3-d037-478d-9641-180fe0a6e897 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:36.523783 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-036e15c3-d037-478d-9641-180fe0a6e897 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:36.524228 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-036e15c3-d037-478d-9641-180fe0a6e897 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:36.525048 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-036e15c3-d037-478d-9641-180fe0a6e897 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:36.525467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-036e15c3-d037-478d-9641-180fe0a6e897 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:36.689598 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-036e15c3-d037-478d-9641-180fe0a6e897 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:36.706508 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-036e15c3-d037-478d-9641-180fe0a6e897 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:36.708244 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-036e15c3-d037-478d-9641-180fe0a6e897 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:36.710323 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-036e15c3-d037-478d-9641-180fe0a6e897 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1723 microversion: 2.20 time: 0.197567 May 27 15:21:36.711185 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 423/869] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:36 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:36.848936 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-bbc53701-acac-4551-9f4e-c51cc2dd3a97 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:36.850333 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-bbc53701-acac-4551-9f4e-c51cc2dd3a97 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:36.859937 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bbc53701-acac-4551-9f4e-c51cc2dd3a97 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:36.860387 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bbc53701-acac-4551-9f4e-c51cc2dd3a97 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:36.861165 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bbc53701-acac-4551-9f4e-c51cc2dd3a97 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:36.861602 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-bbc53701-acac-4551-9f4e-c51cc2dd3a97 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:36.995731 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-bbc53701-acac-4551-9f4e-c51cc2dd3a97 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:37.006055 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-bbc53701-acac-4551-9f4e-c51cc2dd3a97 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1570 microversion: 2.1 time: 0.160972 May 27 15:21:37.007767 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 447/870] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:36 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:37.025467 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-5517ac4e-63f7-4f69-a7f3-3f5932a27e4b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:37.026059 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-5517ac4e-63f7-4f69-a7f3-3f5932a27e4b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:37.033158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5517ac4e-63f7-4f69-a7f3-3f5932a27e4b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:37.033930 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5517ac4e-63f7-4f69-a7f3-3f5932a27e4b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:37.034842 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5517ac4e-63f7-4f69-a7f3-3f5932a27e4b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:37.035476 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5517ac4e-63f7-4f69-a7f3-3f5932a27e4b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:37.181554 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-5517ac4e-63f7-4f69-a7f3-3f5932a27e4b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "POST /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e/action" status: 202 len: 0 microversion: 2.1 time: 0.161524 May 27 15:21:37.191680 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-5c602dd4-5326-4fd2-8d05-ebae11aa9f76 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:37.192580 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-5c602dd4-5326-4fd2-8d05-ebae11aa9f76 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:37.195088 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=64 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:37.196733 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 424/871] 10.222.0.50 () {60 vars in 1277 bytes} [Fri May 27 15:21:37 2022] POST /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:21:37.201823 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5c602dd4-5326-4fd2-8d05-ebae11aa9f76 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:37.202983 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5c602dd4-5326-4fd2-8d05-ebae11aa9f76 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:37.206222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5c602dd4-5326-4fd2-8d05-ebae11aa9f76 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:37.206967 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5c602dd4-5326-4fd2-8d05-ebae11aa9f76 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:37.235328 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-336fd594-9718-45ed-8312-ce8260ba9745 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:37.236207 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-336fd594-9718-45ed-8312-ce8260ba9745 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:37.246525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-336fd594-9718-45ed-8312-ce8260ba9745 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:37.251074 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-336fd594-9718-45ed-8312-ce8260ba9745 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:37.252291 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-336fd594-9718-45ed-8312-ce8260ba9745 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:37.253113 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-336fd594-9718-45ed-8312-ce8260ba9745 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:37.428523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-336fd594-9718-45ed-8312-ce8260ba9745 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:37.436194 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-336fd594-9718-45ed-8312-ce8260ba9745 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1606 microversion: 2.1 time: 0.207405 May 27 15:21:37.443821 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5c602dd4-5326-4fd2-8d05-ebae11aa9f76 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:37.445149 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 425/872] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:37 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1606 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:37.451221 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-5c602dd4-5326-4fd2-8d05-ebae11aa9f76 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1578 microversion: 2.1 time: 0.264235 May 27 15:21:37.451815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 448/873] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:37 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1578 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:37.619164 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-c1c0ee72-73bc-488c-84f0-02fba6e6e760 req-8e3e5240-88fb-4729-99ef-52f28775ad8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e4355e-ea71-44c5-90ae-0ec0406a5d6e", "name": "network-vif-unplugged", "status": "completed", "tag": "58c057d0-cc07-4dc4-ab97-0024ba4d6dfd"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:37.633980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-c1c0ee72-73bc-488c-84f0-02fba6e6e760 req-8e3e5240-88fb-4729-99ef-52f28775ad8a service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:37.634679 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-c1c0ee72-73bc-488c-84f0-02fba6e6e760 req-8e3e5240-88fb-4729-99ef-52f28775ad8a service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:37.654585 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.compute.server_external_events [req-c1c0ee72-73bc-488c-84f0-02fba6e6e760 req-8e3e5240-88fb-4729-99ef-52f28775ad8a service nova] Unable to find a host for instance 16e4355e-ea71-44c5-90ae-0ec0406a5d6e. Dropping event network-vif-unplugged {{(pid=117743) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 27 15:21:37.655978 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-c1c0ee72-73bc-488c-84f0-02fba6e6e760 req-8e3e5240-88fb-4729-99ef-52f28775ad8a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.044192 May 27 15:21:37.657161 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 426/874] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 27 15:21:37.739297 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-44c39c8a-27b1-4c98-a21f-5c5a94e7a75c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:37.739908 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-44c39c8a-27b1-4c98-a21f-5c5a94e7a75c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:37.750965 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-44c39c8a-27b1-4c98-a21f-5c5a94e7a75c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:37.751657 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-44c39c8a-27b1-4c98-a21f-5c5a94e7a75c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:37.752610 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-44c39c8a-27b1-4c98-a21f-5c5a94e7a75c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:37.753191 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-44c39c8a-27b1-4c98-a21f-5c5a94e7a75c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:37.847065 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-4e44de48-d708-4f8f-bc5e-0761e4d143c0 req-4459a3ac-0c32-40cd-b640-03762542b47d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4a7119-2de1-4f92-a310-bdd2eb2aa316", "name": "network-vif-deleted", "tag": "37e04985-41a3-46a7-bd4a-0d11189b7fbf"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:37.859118 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-4e44de48-d708-4f8f-bc5e-0761e4d143c0 req-4459a3ac-0c32-40cd-b640-03762542b47d service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:37.859911 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-4e44de48-d708-4f8f-bc5e-0761e4d143c0 req-4459a3ac-0c32-40cd-b640-03762542b47d service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:37.881072 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-4e44de48-d708-4f8f-bc5e-0761e4d143c0 req-4459a3ac-0c32-40cd-b640-03762542b47d service nova] Creating event network-vif-deleted:37e04985-41a3-46a7-bd4a-0d11189b7fbf for instance fe4a7119-2de1-4f92-a310-bdd2eb2aa316 on hv-cinder-84254 May 27 15:21:37.888666 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-4e44de48-d708-4f8f-bc5e-0761e4d143c0 req-4459a3ac-0c32-40cd-b640-03762542b47d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045455 May 27 15:21:37.889405 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 427/875] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:37.939847 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-44c39c8a-27b1-4c98-a21f-5c5a94e7a75c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:37.951963 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-44c39c8a-27b1-4c98-a21f-5c5a94e7a75c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:37.953779 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-44c39c8a-27b1-4c98-a21f-5c5a94e7a75c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:37.955183 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-44c39c8a-27b1-4c98-a21f-5c5a94e7a75c tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1723 microversion: 2.20 time: 0.219821 May 27 15:21:37.966417 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 449/876] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:37 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:38.455005 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-caa33d07-b52a-4948-a3d8-284cacbbc22d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:38.455714 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-caa33d07-b52a-4948-a3d8-284cacbbc22d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:38.464588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-caa33d07-b52a-4948-a3d8-284cacbbc22d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:38.465297 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-caa33d07-b52a-4948-a3d8-284cacbbc22d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:38.466435 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-caa33d07-b52a-4948-a3d8-284cacbbc22d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:38.467145 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-caa33d07-b52a-4948-a3d8-284cacbbc22d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:38.473053 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b8ef3155-777a-4616-8a47-c37939853a4e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:38.474260 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b8ef3155-777a-4616-8a47-c37939853a4e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:38.486016 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b8ef3155-777a-4616-8a47-c37939853a4e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:38.486964 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b8ef3155-777a-4616-8a47-c37939853a4e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:38.488637 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b8ef3155-777a-4616-8a47-c37939853a4e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:38.489235 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b8ef3155-777a-4616-8a47-c37939853a4e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:38.527270 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:38.536368 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-caa33d07-b52a-4948-a3d8-284cacbbc22d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:38.545811 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-caa33d07-b52a-4948-a3d8-284cacbbc22d tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1606 microversion: 2.1 time: 0.095132 May 27 15:21:38.547897 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 428/877] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:38 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1606 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:38.677785 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b8ef3155-777a-4616-8a47-c37939853a4e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:38.688670 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b8ef3155-777a-4616-8a47-c37939853a4e tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1518 microversion: 2.1 time: 0.222796 May 27 15:21:38.690881 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 450/878] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:38 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1518 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:38.975916 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-70f282d9-4d1e-401a-8bd0-92b32c8e1c3a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:38.976553 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-70f282d9-4d1e-401a-8bd0-92b32c8e1c3a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:38.983858 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-70f282d9-4d1e-401a-8bd0-92b32c8e1c3a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:38.984315 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-70f282d9-4d1e-401a-8bd0-92b32c8e1c3a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:38.985088 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-70f282d9-4d1e-401a-8bd0-92b32c8e1c3a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:38.985511 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-70f282d9-4d1e-401a-8bd0-92b32c8e1c3a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:39.127074 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-70f282d9-4d1e-401a-8bd0-92b32c8e1c3a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:39.135223 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-70f282d9-4d1e-401a-8bd0-92b32c8e1c3a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:39.136712 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-70f282d9-4d1e-401a-8bd0-92b32c8e1c3a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:39.137859 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-70f282d9-4d1e-401a-8bd0-92b32c8e1c3a tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1723 microversion: 2.20 time: 0.166741 May 27 15:21:39.138418 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 429/879] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:38 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:39.564689 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b95358bc-4e6d-4793-bc74-0af07201e031 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:39.565337 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b95358bc-4e6d-4793-bc74-0af07201e031 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:39.572357 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b95358bc-4e6d-4793-bc74-0af07201e031 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:39.572815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b95358bc-4e6d-4793-bc74-0af07201e031 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:39.573594 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b95358bc-4e6d-4793-bc74-0af07201e031 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:39.574036 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b95358bc-4e6d-4793-bc74-0af07201e031 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:39.612355 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b95358bc-4e6d-4793-bc74-0af07201e031 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:39.612807 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b95358bc-4e6d-4793-bc74-0af07201e031 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:39.613257 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.objects.instance [None req-b95358bc-4e6d-4793-bc74-0af07201e031 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lazy-loading 'fault' on Instance uuid fe4a7119-2de1-4f92-a310-bdd2eb2aa316 {{(pid=117742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:21:39.657186 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b95358bc-4e6d-4793-bc74-0af07201e031 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387048f42b634693a7e827a8d88ef89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bf15a964f8048b48bc794051cd56add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:39.665484 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b95358bc-4e6d-4793-bc74-0af07201e031 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 200 len: 1327 microversion: 2.1 time: 0.104703 May 27 15:21:39.666055 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 451/880] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:39 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:39.677365 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-061a935a-3670-4dd2-a635-8bdc9df3a289 req-40bba42a-c3f2-438c-8307-ee401b93c119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1c52039-f595-4f22-9df9-ea3a999f55fe", "name": "network-vif-unplugged", "status": "completed", "tag": "00ae88d7-8fbc-40d5-aefb-819837b95c30"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:39.685535 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-061a935a-3670-4dd2-a635-8bdc9df3a289 req-40bba42a-c3f2-438c-8307-ee401b93c119 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:39.685979 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-061a935a-3670-4dd2-a635-8bdc9df3a289 req-40bba42a-c3f2-438c-8307-ee401b93c119 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:39.701721 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-061a935a-3670-4dd2-a635-8bdc9df3a289 req-40bba42a-c3f2-438c-8307-ee401b93c119 service nova] Creating event network-vif-unplugged:00ae88d7-8fbc-40d5-aefb-819837b95c30 for instance f1c52039-f595-4f22-9df9-ea3a999f55fe on hv-cinder-84254 May 27 15:21:39.705368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-0e00420b-5763-4ad4-8139-4bf1151d9474 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:39.706012 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-0e00420b-5763-4ad4-8139-4bf1151d9474 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:39.709042 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-061a935a-3670-4dd2-a635-8bdc9df3a289 req-40bba42a-c3f2-438c-8307-ee401b93c119 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034944 May 27 15:21:39.710641 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 430/881] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:39.714246 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0e00420b-5763-4ad4-8139-4bf1151d9474 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:39.714727 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0e00420b-5763-4ad4-8139-4bf1151d9474 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:39.715540 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0e00420b-5763-4ad4-8139-4bf1151d9474 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:39.715983 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0e00420b-5763-4ad4-8139-4bf1151d9474 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:39.866339 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-0e00420b-5763-4ad4-8139-4bf1151d9474 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:39.877729 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-0e00420b-5763-4ad4-8139-4bf1151d9474 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1520 microversion: 2.1 time: 0.175505 May 27 15:21:39.888685 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 452/882] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:39 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:40.157888 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-faab1c58-8408-4731-a5af-6ad584e495d4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:40.158768 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-faab1c58-8408-4731-a5af-6ad584e495d4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:40.165797 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-faab1c58-8408-4731-a5af-6ad584e495d4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:40.166246 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-faab1c58-8408-4731-a5af-6ad584e495d4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:40.167084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-faab1c58-8408-4731-a5af-6ad584e495d4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:40.167481 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-faab1c58-8408-4731-a5af-6ad584e495d4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:40.313720 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-faab1c58-8408-4731-a5af-6ad584e495d4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:40.324124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-faab1c58-8408-4731-a5af-6ad584e495d4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:40.325980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-faab1c58-8408-4731-a5af-6ad584e495d4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:40.327454 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-faab1c58-8408-4731-a5af-6ad584e495d4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1666 microversion: 2.20 time: 0.174784 May 27 15:21:40.328007 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 431/883] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:40 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1666 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:40.345842 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f7ca8724-4d33-41a9-968a-ac88db4589a5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "905d01bb-c7c3-4a08-991f-8ad9281ab597"}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:40.347180 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f7ca8724-4d33-41a9-968a-ac88db4589a5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:40.354782 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f7ca8724-4d33-41a9-968a-ac88db4589a5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:40.355345 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f7ca8724-4d33-41a9-968a-ac88db4589a5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:40.356134 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f7ca8724-4d33-41a9-968a-ac88db4589a5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:40.356765 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f7ca8724-4d33-41a9-968a-ac88db4589a5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:40.646487 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f7ca8724-4d33-41a9-968a-ac88db4589a5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "POST /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.305025 May 27 15:21:40.647837 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 453/884] 10.222.0.50 () {62 vars in 1363 bytes} [Fri May 27 15:21:40 2022] POST /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe/os-volume_attachments => generated 188 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 15:21:40.683789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b77e8e02-dc02-4db7-82df-a86a8c7b242c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:40.684487 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b77e8e02-dc02-4db7-82df-a86a8c7b242c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:40.691387 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b77e8e02-dc02-4db7-82df-a86a8c7b242c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:40.691859 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b77e8e02-dc02-4db7-82df-a86a8c7b242c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:40.692685 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b77e8e02-dc02-4db7-82df-a86a8c7b242c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:40.693153 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b77e8e02-dc02-4db7-82df-a86a8c7b242c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:40.711184 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-b77e8e02-dc02-4db7-82df-a86a8c7b242c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] HTTP exception thrown: Instance fe4a7119-2de1-4f92-a310-bdd2eb2aa316 could not be found. May 27 15:21:40.713139 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b77e8e02-dc02-4db7-82df-a86a8c7b242c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Request method failure captured: May 27 15:21:40.713139 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 HTTP/1.1 May 27 15:21:40.713139 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:21:40.713139 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:21:40.713139 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:21:40.713139 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 0 May 27 15:21:40.713139 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:21:40.713139 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:21:40.713139 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:21:40.713139 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:21:40.713139 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOrwVPMKqGva0TqpnvQqy9GorwPqfdKa_jfChiWsOWfuH4HZt9x_1f4GiPTECprJW-Jg2kdbZGUWG7dV_-0FnTd9CT-7i9Q3IDc58WmKKPlyVUKIAVD90kCkm4vUmKhTkH2z1K5cbI_o-ZQqGAYbrkKQR9TBlFa1hb370GJqQHyoR-M May 27 15:21:40.713139 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:21:40.713139 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:21:40.713139 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:21:40.713139 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:21:40.713139 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:21:40.713139 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:21:40.713139 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: 0bf15a964f8048b48bc794051cd56add May 27 15:21:40.713139 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-AttachVolumeTestJSON-17996642 May 27 15:21:40.713139 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:21:40.713139 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:21:40.714825 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0bf15a964f8048b48bc794051cd56add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0bf15a964f8048b48bc794051cd56add"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0bf15a964f8048b48bc794051cd56add"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0bf15a964f8048b48bc794051cd56add"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:21:40.714825 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-AttachVolumeTestJSON-17996642 May 27 15:21:40.714825 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: 0bf15a964f8048b48bc794051cd56add May 27 15:21:40.714825 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-AttachVolumeTestJSON-17996642 May 27 15:21:40.714825 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-AttachVolumeTestJSON-17996642-project May 27 15:21:40.714825 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:21:40.714825 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:21:40.714825 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: 387048f42b634693a7e827a8d88ef89b May 27 15:21:40.714825 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-AttachVolumeTestJSON-17996642-project May 27 15:21:40.714825 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: > May 27 15:21:40.714825 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Instance fe4a7119-2de1-4f92-a310-bdd2eb2aa316 could not be found. May 27 15:21:40.714825 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'id': 'fe4a7119-2de1-4f92-a310-bdd2eb2aa316'} May 27 15:21:40.715904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:21:40.715904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:40.715904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:21:40.715904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:21:40.715904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:21:40.715904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:21:40.715904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:21:40.715904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:21:40.715904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:21:40.715904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:21:40.715904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe4a7119-2de1-4f92-a310-bdd2eb2aa316 could not be found. May 27 15:21:40.715904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:21:40.715904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:40.715904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:21:40.715904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:40.715904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:40.715904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:40.715904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:21:40.715904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:21:40.715904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:21:40.717564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:21:40.717564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:21:40.717564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:21:40.717564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:21:40.717564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:21:40.717564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:21:40.717564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:21:40.717564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe4a7119-2de1-4f92-a310-bdd2eb2aa316 could not be found. May 27 15:21:40.717564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:21:40.717564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:40.717564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:21:40.717564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:40.717564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:40.717564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:40.717564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:21:40.717564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:21:40.717564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe4a7119-2de1-4f92-a310-bdd2eb2aa316 could not be found. May 27 15:21:40.717564 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:21:40.720131 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b77e8e02-dc02-4db7-82df-a86a8c7b242c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Returning 404 to user: Instance fe4a7119-2de1-4f92-a310-bdd2eb2aa316 could not be found. {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:21:40.720993 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b77e8e02-dc02-4db7-82df-a86a8c7b242c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 404 len: 111 microversion: 2.1 time: 0.042397 May 27 15:21:40.721841 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 432/885] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:40 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:21:40.730412 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-468fc507-176c-4342-a334-ffb4d591ac23 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '.version_select at 0x7f57e178caf0>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:40.749188 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-468fc507-176c-4342-a334-ffb4d591ac23 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1920697467" status: 202 len: 0 microversion: 2.1 time: 0.022940 May 27 15:21:40.749888 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 454/886] 10.222.0.50 () {58 vars in 1220 bytes} [Fri May 27 15:21:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1920697467 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:21:40.780994 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9da7ab77-d6aa-4435-8733-4dff05d93d87 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:40.781664 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9da7ab77-d6aa-4435-8733-4dff05d93d87 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:40.787844 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9da7ab77-d6aa-4435-8733-4dff05d93d87 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:40.788292 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9da7ab77-d6aa-4435-8733-4dff05d93d87 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:40.789056 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9da7ab77-d6aa-4435-8733-4dff05d93d87 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:40.789485 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9da7ab77-d6aa-4435-8733-4dff05d93d87 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:40.896037 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-15cab95d-6ad5-4cd6-988f-eefe5852d497 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:40.896957 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-15cab95d-6ad5-4cd6-988f-eefe5852d497 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:40.903899 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-15cab95d-6ad5-4cd6-988f-eefe5852d497 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:40.904332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-15cab95d-6ad5-4cd6-988f-eefe5852d497 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:40.905109 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-15cab95d-6ad5-4cd6-988f-eefe5852d497 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:40.905542 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-15cab95d-6ad5-4cd6-988f-eefe5852d497 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:41.056645 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-15cab95d-6ad5-4cd6-988f-eefe5852d497 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:41.059065 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9da7ab77-d6aa-4435-8733-4dff05d93d87 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe/os-volume_attachments/905d01bb-c7c3-4a08-991f-8ad9281ab597" status: 202 len: 0 microversion: 2.20 time: 0.281896 May 27 15:21:41.059920 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 433/887] 10.222.0.50 () {60 vars in 1456 bytes} [Fri May 27 15:21:40 2022] DELETE /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe/os-volume_attachments/905d01bb-c7c3-4a08-991f-8ad9281ab597 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 15:21:41.074392 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-15cab95d-6ad5-4cd6-988f-eefe5852d497 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1576 microversion: 2.1 time: 0.178594 May 27 15:21:41.075320 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 455/888] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:40 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:41.134476 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b0cfe67c-62ec-414d-847d-dc01ff0ef467 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:41.135222 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b0cfe67c-62ec-414d-847d-dc01ff0ef467 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:41.145263 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b0cfe67c-62ec-414d-847d-dc01ff0ef467 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:41.145850 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b0cfe67c-62ec-414d-847d-dc01ff0ef467 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:41.146895 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b0cfe67c-62ec-414d-847d-dc01ff0ef467 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:41.147809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b0cfe67c-62ec-414d-847d-dc01ff0ef467 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:41.237858 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b0cfe67c-62ec-414d-847d-dc01ff0ef467 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "POST /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe/action" status: 202 len: 0 microversion: 2.20 time: 0.109915 May 27 15:21:41.242377 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 434/889] 10.222.0.50 () {62 vars in 1318 bytes} [Fri May 27 15:21:41 2022] POST /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 15:21:41.247472 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-c018fee2-f9fe-4bcc-8574-a5c4d5b24701 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:41.248083 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-c018fee2-f9fe-4bcc-8574-a5c4d5b24701 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:41.255505 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c018fee2-f9fe-4bcc-8574-a5c4d5b24701 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:41.255956 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c018fee2-f9fe-4bcc-8574-a5c4d5b24701 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:41.257265 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c018fee2-f9fe-4bcc-8574-a5c4d5b24701 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:41.257762 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c018fee2-f9fe-4bcc-8574-a5c4d5b24701 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:41.514011 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-c018fee2-f9fe-4bcc-8574-a5c4d5b24701 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:41.536369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-c018fee2-f9fe-4bcc-8574-a5c4d5b24701 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:41.538544 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-c018fee2-f9fe-4bcc-8574-a5c4d5b24701 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:41.541535 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-c018fee2-f9fe-4bcc-8574-a5c4d5b24701 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1674 microversion: 2.20 time: 0.297486 May 27 15:21:41.547431 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 456/890] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:41 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1674 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:42.091611 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-43da49bf-cc33-4457-88c7-b861a86e1658 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:42.092415 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-43da49bf-cc33-4457-88c7-b861a86e1658 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:42.100550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-43da49bf-cc33-4457-88c7-b861a86e1658 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:42.101717 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-43da49bf-cc33-4457-88c7-b861a86e1658 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:42.103041 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-43da49bf-cc33-4457-88c7-b861a86e1658 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:42.103740 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-43da49bf-cc33-4457-88c7-b861a86e1658 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:42.362464 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-43da49bf-cc33-4457-88c7-b861a86e1658 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:42.371764 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-43da49bf-cc33-4457-88c7-b861a86e1658 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1576 microversion: 2.1 time: 0.284425 May 27 15:21:42.372345 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 435/891] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:42 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1576 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:42.565631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-aa7e23ea-ed45-4873-9ac7-44eddf18f9e6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:42.566242 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-aa7e23ea-ed45-4873-9ac7-44eddf18f9e6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:42.573685 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-aa7e23ea-ed45-4873-9ac7-44eddf18f9e6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:42.574135 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-aa7e23ea-ed45-4873-9ac7-44eddf18f9e6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:42.574927 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-aa7e23ea-ed45-4873-9ac7-44eddf18f9e6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:42.575375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-aa7e23ea-ed45-4873-9ac7-44eddf18f9e6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:42.807494 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-aa7e23ea-ed45-4873-9ac7-44eddf18f9e6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:42.821203 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-aa7e23ea-ed45-4873-9ac7-44eddf18f9e6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:42.822784 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-aa7e23ea-ed45-4873-9ac7-44eddf18f9e6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:42.824922 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-aa7e23ea-ed45-4873-9ac7-44eddf18f9e6 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1676 microversion: 2.20 time: 0.262438 May 27 15:21:42.825511 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 457/892] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:42 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1676 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:43.388839 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b724990d-5952-4b94-973a-eeb2747eb69f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:43.389451 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b724990d-5952-4b94-973a-eeb2747eb69f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:43.396458 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b724990d-5952-4b94-973a-eeb2747eb69f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:43.396936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b724990d-5952-4b94-973a-eeb2747eb69f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:43.398622 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b724990d-5952-4b94-973a-eeb2747eb69f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:43.399097 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b724990d-5952-4b94-973a-eeb2747eb69f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:43.551539 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b724990d-5952-4b94-973a-eeb2747eb69f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:43.560942 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b724990d-5952-4b94-973a-eeb2747eb69f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1576 microversion: 2.1 time: 0.176064 May 27 15:21:43.561877 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 436/893] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:43 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:43.844933 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-6cc6025d-10f9-410e-8986-e0d22959e86b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:43.845537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-6cc6025d-10f9-410e-8986-e0d22959e86b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:43.853200 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6cc6025d-10f9-410e-8986-e0d22959e86b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:43.853639 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6cc6025d-10f9-410e-8986-e0d22959e86b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:43.854397 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6cc6025d-10f9-410e-8986-e0d22959e86b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:43.854827 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6cc6025d-10f9-410e-8986-e0d22959e86b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:44.008408 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6cc6025d-10f9-410e-8986-e0d22959e86b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:44.018060 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6cc6025d-10f9-410e-8986-e0d22959e86b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:44.019709 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6cc6025d-10f9-410e-8986-e0d22959e86b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:44.021042 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-6cc6025d-10f9-410e-8986-e0d22959e86b tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1732 microversion: 2.20 time: 0.180497 May 27 15:21:44.021812 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 458/894] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:43 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:44.041097 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-8e693647-105c-4d10-a049-c0f96d9f1aa8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:44.041828 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-8e693647-105c-4d10-a049-c0f96d9f1aa8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:44.050790 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8e693647-105c-4d10-a049-c0f96d9f1aa8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:44.051396 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8e693647-105c-4d10-a049-c0f96d9f1aa8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:44.052545 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8e693647-105c-4d10-a049-c0f96d9f1aa8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:44.053215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8e693647-105c-4d10-a049-c0f96d9f1aa8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:44.068820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-8e693647-105c-4d10-a049-c0f96d9f1aa8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] HTTP exception thrown: Instance fe4a7119-2de1-4f92-a310-bdd2eb2aa316 could not be found. May 27 15:21:44.070391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-8e693647-105c-4d10-a049-c0f96d9f1aa8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Request method failure captured: May 27 15:21:44.070391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: DELETE /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 HTTP/1.1 May 27 15:21:44.070391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:21:44.070391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:21:44.070391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:21:44.070391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 0 May 27 15:21:44.070391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:21:44.070391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:21:44.070391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:21:44.070391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:21:44.070391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOrwVPMKqGva0TqpnvQqy9GorwPqfdKa_jfChiWsOWfuH4HZt9x_1f4GiPTECprJW-Jg2kdbZGUWG7dV_-0FnTd9CT-7i9Q3IDc58WmKKPlyVUKIAVD90kCkm4vUmKhTkH2z1K5cbI_o-ZQqGAYbrkKQR9TBlFa1hb370GJqQHyoR-M May 27 15:21:44.070391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:21:44.070391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:21:44.070391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:21:44.070391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:21:44.070391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:21:44.070391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:21:44.070391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: 0bf15a964f8048b48bc794051cd56add May 27 15:21:44.070391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-AttachVolumeTestJSON-17996642 May 27 15:21:44.070391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:21:44.070391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:21:44.072184 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0bf15a964f8048b48bc794051cd56add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0bf15a964f8048b48bc794051cd56add"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0bf15a964f8048b48bc794051cd56add"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0bf15a964f8048b48bc794051cd56add"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:21:44.072184 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-AttachVolumeTestJSON-17996642 May 27 15:21:44.072184 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: 0bf15a964f8048b48bc794051cd56add May 27 15:21:44.072184 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-AttachVolumeTestJSON-17996642 May 27 15:21:44.072184 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-AttachVolumeTestJSON-17996642-project May 27 15:21:44.072184 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:21:44.072184 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:21:44.072184 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: 387048f42b634693a7e827a8d88ef89b May 27 15:21:44.072184 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-AttachVolumeTestJSON-17996642-project May 27 15:21:44.072184 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: > May 27 15:21:44.072184 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Instance fe4a7119-2de1-4f92-a310-bdd2eb2aa316 could not be found. May 27 15:21:44.072184 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'id': 'fe4a7119-2de1-4f92-a310-bdd2eb2aa316'} May 27 15:21:44.073015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:21:44.073015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:44.073015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:21:44.073015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:21:44.073015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:21:44.073015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:21:44.073015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:21:44.073015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:21:44.073015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:21:44.073015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:21:44.073015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe4a7119-2de1-4f92-a310-bdd2eb2aa316 could not be found. May 27 15:21:44.073015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:21:44.073015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:44.073015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:21:44.073015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:44.073015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:44.073015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:44.073015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:21:44.073015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:21:44.073015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:21:44.074216 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:21:44.074216 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:21:44.074216 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:21:44.074216 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:21:44.074216 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:21:44.074216 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:21:44.074216 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:21:44.074216 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:21:44.074216 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:21:44.074216 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe4a7119-2de1-4f92-a310-bdd2eb2aa316 could not be found. May 27 15:21:44.074216 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:21:44.074216 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:44.074216 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:21:44.074216 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:44.074216 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:44.074216 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:44.074216 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:21:44.074216 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:21:44.074216 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe4a7119-2de1-4f92-a310-bdd2eb2aa316 could not be found. May 27 15:21:44.074216 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:21:44.075469 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-8e693647-105c-4d10-a049-c0f96d9f1aa8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Returning 404 to user: Instance fe4a7119-2de1-4f92-a310-bdd2eb2aa316 could not be found. {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:21:44.075469 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-8e693647-105c-4d10-a049-c0f96d9f1aa8 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 404 len: 111 microversion: 2.1 time: 0.039314 May 27 15:21:44.076609 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 437/895] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:21:44 2022] DELETE /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:21:44.081029 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-57372f3e-7ea0-49d9-8ed2-b6684056667f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:44.081642 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-57372f3e-7ea0-49d9-8ed2-b6684056667f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: fe4a7119-2de1-4f92-a310-bdd2eb2aa316] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:44.088743 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-57372f3e-7ea0-49d9-8ed2-b6684056667f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:44.089438 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-57372f3e-7ea0-49d9-8ed2-b6684056667f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:44.090206 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-57372f3e-7ea0-49d9-8ed2-b6684056667f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:44.090793 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-57372f3e-7ea0-49d9-8ed2-b6684056667f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:44.105322 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-57372f3e-7ea0-49d9-8ed2-b6684056667f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] HTTP exception thrown: Instance fe4a7119-2de1-4f92-a310-bdd2eb2aa316 could not be found. May 27 15:21:44.107222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-57372f3e-7ea0-49d9-8ed2-b6684056667f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Request method failure captured: May 27 15:21:44.107222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 HTTP/1.1 May 27 15:21:44.107222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:21:44.107222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:21:44.107222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:21:44.107222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:21:44.107222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:21:44.107222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:21:44.107222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:21:44.107222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:21:44.107222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOrwVPMKqGva0TqpnvQqy9GorwPqfdKa_jfChiWsOWfuH4HZt9x_1f4GiPTECprJW-Jg2kdbZGUWG7dV_-0FnTd9CT-7i9Q3IDc58WmKKPlyVUKIAVD90kCkm4vUmKhTkH2z1K5cbI_o-ZQqGAYbrkKQR9TBlFa1hb370GJqQHyoR-M May 27 15:21:44.107222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:21:44.107222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:21:44.107222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:21:44.107222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:21:44.107222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:21:44.107222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:21:44.107222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: 0bf15a964f8048b48bc794051cd56add May 27 15:21:44.107222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-AttachVolumeTestJSON-17996642 May 27 15:21:44.107222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:21:44.107222 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:21:44.108781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0bf15a964f8048b48bc794051cd56add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0bf15a964f8048b48bc794051cd56add"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0bf15a964f8048b48bc794051cd56add"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0bf15a964f8048b48bc794051cd56add"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:21:44.108781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-AttachVolumeTestJSON-17996642 May 27 15:21:44.108781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: 0bf15a964f8048b48bc794051cd56add May 27 15:21:44.108781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-AttachVolumeTestJSON-17996642 May 27 15:21:44.108781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-AttachVolumeTestJSON-17996642-project May 27 15:21:44.108781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:21:44.108781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:21:44.108781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 387048f42b634693a7e827a8d88ef89b May 27 15:21:44.108781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-AttachVolumeTestJSON-17996642-project May 27 15:21:44.108781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:21:44.108781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance fe4a7119-2de1-4f92-a310-bdd2eb2aa316 could not be found. May 27 15:21:44.108781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': 'fe4a7119-2de1-4f92-a310-bdd2eb2aa316'} May 27 15:21:44.109651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:21:44.109651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:44.109651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:21:44.109651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:21:44.109651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:21:44.109651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:21:44.109651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:21:44.109651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:21:44.109651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:21:44.109651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:21:44.109651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe4a7119-2de1-4f92-a310-bdd2eb2aa316 could not be found. May 27 15:21:44.109651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:21:44.109651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:44.109651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:21:44.109651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:44.109651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:44.109651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:44.109651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:21:44.109651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:21:44.109651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:21:44.111362 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:21:44.111362 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:21:44.111362 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:21:44.111362 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:21:44.111362 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:21:44.111362 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:21:44.111362 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:21:44.111362 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe4a7119-2de1-4f92-a310-bdd2eb2aa316 could not be found. May 27 15:21:44.111362 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:21:44.111362 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:44.111362 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:21:44.111362 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:44.111362 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:44.111362 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:44.111362 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:21:44.111362 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:21:44.111362 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe4a7119-2de1-4f92-a310-bdd2eb2aa316 could not be found. May 27 15:21:44.111362 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:21:44.112662 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-57372f3e-7ea0-49d9-8ed2-b6684056667f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Returning 404 to user: Instance fe4a7119-2de1-4f92-a310-bdd2eb2aa316 could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:21:44.112662 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-57372f3e-7ea0-49d9-8ed2-b6684056667f tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316" status: 404 len: 111 microversion: 2.1 time: 0.031471 May 27 15:21:44.112662 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 459/896] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:44 2022] GET /compute/v2.1/servers/fe4a7119-2de1-4f92-a310-bdd2eb2aa316 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:21:44.579931 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-7eb80aaf-c57b-4df3-903a-bff97895e941 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:44.580521 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-7eb80aaf-c57b-4df3-903a-bff97895e941 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:44.589002 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-7eb80aaf-c57b-4df3-903a-bff97895e941 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:44.589553 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-7eb80aaf-c57b-4df3-903a-bff97895e941 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:44.591086 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-7eb80aaf-c57b-4df3-903a-bff97895e941 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:44.591871 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-7eb80aaf-c57b-4df3-903a-bff97895e941 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:44.598960 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:44.782585 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-7eb80aaf-c57b-4df3-903a-bff97895e941 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:44.791753 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-7eb80aaf-c57b-4df3-903a-bff97895e941 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1576 microversion: 2.1 time: 0.216706 May 27 15:21:44.796122 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 438/897] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:44 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1576 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:45.049952 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-0f753a89-9470-47dc-9113-82c70fa41037 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:45.051155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-0f753a89-9470-47dc-9113-82c70fa41037 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:45.063716 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0f753a89-9470-47dc-9113-82c70fa41037 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:45.064425 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0f753a89-9470-47dc-9113-82c70fa41037 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:45.067107 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0f753a89-9470-47dc-9113-82c70fa41037 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:45.068225 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0f753a89-9470-47dc-9113-82c70fa41037 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:45.257623 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-0f753a89-9470-47dc-9113-82c70fa41037 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:45.268033 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-0f753a89-9470-47dc-9113-82c70fa41037 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:45.269739 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-0f753a89-9470-47dc-9113-82c70fa41037 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:45.270828 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-0f753a89-9470-47dc-9113-82c70fa41037 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1732 microversion: 2.20 time: 0.224808 May 27 15:21:45.271794 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 460/898] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:45 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1732 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:45.327282 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-77e84ba1-e647-4c06-a484-3f99f07c856c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:45.327848 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-77e84ba1-e647-4c06-a484-3f99f07c856c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:45.335407 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-77e84ba1-e647-4c06-a484-3f99f07c856c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:45.336203 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-77e84ba1-e647-4c06-a484-3f99f07c856c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:45.337432 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-77e84ba1-e647-4c06-a484-3f99f07c856c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:45.337933 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-77e84ba1-e647-4c06-a484-3f99f07c856c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:45.354135 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-77e84ba1-e647-4c06-a484-3f99f07c856c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] HTTP exception thrown: Instance f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 could not be found. May 27 15:21:45.355754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-77e84ba1-e647-4c06-a484-3f99f07c856c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Request method failure captured: May 27 15:21:45.355754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: DELETE /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 HTTP/1.1 May 27 15:21:45.355754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:21:45.355754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:21:45.355754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:21:45.355754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 0 May 27 15:21:45.355754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:21:45.355754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:21:45.355754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:21:45.355754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:21:45.355754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOrwVPMKqGva0TqpnvQqy9GorwPqfdKa_jfChiWsOWfuH4HZt9x_1f4GiPTECprJW-Jg2kdbZGUWG7dV_-0FnTd9CT-7i9Q3IDc58WmKKPlyVUKIAVD90kCkm4vUmKhTkH2z1K5cbI_o-ZQqGAYbrkKQR9TBlFa1hb370GJqQHyoR-M May 27 15:21:45.355754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:21:45.355754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:21:45.355754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:21:45.355754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:21:45.355754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:21:45.355754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:21:45.355754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: 0bf15a964f8048b48bc794051cd56add May 27 15:21:45.355754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-AttachVolumeTestJSON-17996642 May 27 15:21:45.355754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:21:45.355754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:21:45.357294 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0bf15a964f8048b48bc794051cd56add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0bf15a964f8048b48bc794051cd56add"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0bf15a964f8048b48bc794051cd56add"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0bf15a964f8048b48bc794051cd56add"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:21:45.357294 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-AttachVolumeTestJSON-17996642 May 27 15:21:45.357294 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: 0bf15a964f8048b48bc794051cd56add May 27 15:21:45.357294 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-AttachVolumeTestJSON-17996642 May 27 15:21:45.357294 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-AttachVolumeTestJSON-17996642-project May 27 15:21:45.357294 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:21:45.357294 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:21:45.357294 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: 387048f42b634693a7e827a8d88ef89b May 27 15:21:45.357294 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-AttachVolumeTestJSON-17996642-project May 27 15:21:45.357294 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: > May 27 15:21:45.357294 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Instance f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 could not be found. May 27 15:21:45.357294 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'id': 'f61fd2c2-bca4-412d-93c3-5a3aee3a3b27'} May 27 15:21:45.358146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:21:45.358146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:45.358146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:21:45.358146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:21:45.358146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:21:45.358146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:21:45.358146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:21:45.358146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:21:45.358146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:21:45.358146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:21:45.358146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 could not be found. May 27 15:21:45.358146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:21:45.358146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:45.358146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:21:45.358146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:45.358146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:45.358146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:45.358146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:21:45.358146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:21:45.358146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:21:45.359422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:21:45.359422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:21:45.359422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:21:45.359422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:21:45.359422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:21:45.359422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:21:45.359422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:21:45.359422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:21:45.359422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:21:45.359422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 could not be found. May 27 15:21:45.359422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:21:45.359422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:45.359422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:21:45.359422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:45.359422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:45.359422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:45.359422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:21:45.359422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:21:45.359422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 could not be found. May 27 15:21:45.359422 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:21:45.360820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-77e84ba1-e647-4c06-a484-3f99f07c856c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Returning 404 to user: Instance f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 could not be found. {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:21:45.360820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-77e84ba1-e647-4c06-a484-3f99f07c856c tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 404 len: 111 microversion: 2.1 time: 0.033939 May 27 15:21:45.360820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 439/899] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:21:45 2022] DELETE /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:21:45.366578 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-5e4f1048-b9ab-4db7-93db-cd3d51f10427 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:45.367372 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-5e4f1048-b9ab-4db7-93db-cd3d51f10427 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] [instance: f61fd2c2-bca4-412d-93c3-5a3aee3a3b27] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:45.373541 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5e4f1048-b9ab-4db7-93db-cd3d51f10427 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:45.373980 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5e4f1048-b9ab-4db7-93db-cd3d51f10427 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:45.374737 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5e4f1048-b9ab-4db7-93db-cd3d51f10427 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:45.375354 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5e4f1048-b9ab-4db7-93db-cd3d51f10427 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:45.389803 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-5e4f1048-b9ab-4db7-93db-cd3d51f10427 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] HTTP exception thrown: Instance f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 could not be found. May 27 15:21:45.391383 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-5e4f1048-b9ab-4db7-93db-cd3d51f10427 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Request method failure captured: May 27 15:21:45.391383 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 HTTP/1.1 May 27 15:21:45.391383 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:21:45.391383 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:21:45.391383 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:21:45.391383 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:21:45.391383 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:21:45.391383 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:21:45.391383 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:21:45.391383 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:21:45.391383 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOrwVPMKqGva0TqpnvQqy9GorwPqfdKa_jfChiWsOWfuH4HZt9x_1f4GiPTECprJW-Jg2kdbZGUWG7dV_-0FnTd9CT-7i9Q3IDc58WmKKPlyVUKIAVD90kCkm4vUmKhTkH2z1K5cbI_o-ZQqGAYbrkKQR9TBlFa1hb370GJqQHyoR-M May 27 15:21:45.391383 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:21:45.391383 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:21:45.391383 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:21:45.391383 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:21:45.391383 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:21:45.391383 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:21:45.391383 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: 0bf15a964f8048b48bc794051cd56add May 27 15:21:45.391383 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-AttachVolumeTestJSON-17996642 May 27 15:21:45.391383 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:21:45.391383 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:21:45.392780 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0bf15a964f8048b48bc794051cd56add"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0bf15a964f8048b48bc794051cd56add"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0bf15a964f8048b48bc794051cd56add"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0bf15a964f8048b48bc794051cd56add"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:21:45.392780 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-AttachVolumeTestJSON-17996642 May 27 15:21:45.392780 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: 0bf15a964f8048b48bc794051cd56add May 27 15:21:45.392780 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-AttachVolumeTestJSON-17996642 May 27 15:21:45.392780 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-AttachVolumeTestJSON-17996642-project May 27 15:21:45.392780 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:21:45.392780 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:21:45.392780 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 387048f42b634693a7e827a8d88ef89b May 27 15:21:45.392780 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-AttachVolumeTestJSON-17996642-project May 27 15:21:45.392780 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:21:45.392780 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 could not be found. May 27 15:21:45.392780 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': 'f61fd2c2-bca4-412d-93c3-5a3aee3a3b27'} May 27 15:21:45.394369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:21:45.394369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:45.394369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:21:45.394369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:21:45.394369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:21:45.394369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:21:45.394369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:21:45.394369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:21:45.394369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:21:45.394369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:21:45.394369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 could not be found. May 27 15:21:45.394369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:21:45.394369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:45.394369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:21:45.394369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:45.394369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:45.394369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:45.394369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:21:45.394369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:21:45.394369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:21:45.395885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:21:45.395885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:21:45.395885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:21:45.395885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:21:45.395885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:21:45.395885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:21:45.395885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:21:45.395885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 could not be found. May 27 15:21:45.395885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:21:45.395885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:21:45.395885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:21:45.395885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:21:45.395885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:21:45.395885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:21:45.395885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:21:45.395885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:21:45.395885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 could not be found. May 27 15:21:45.395885 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:21:45.398205 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-5e4f1048-b9ab-4db7-93db-cd3d51f10427 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] Returning 404 to user: Instance f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:21:45.398205 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-5e4f1048-b9ab-4db7-93db-cd3d51f10427 tempest-AttachVolumeTestJSON-17996642 tempest-AttachVolumeTestJSON-17996642-project] 10.222.0.50 "GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27" status: 404 len: 111 microversion: 2.1 time: 0.030759 May 27 15:21:45.398205 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 461/900] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:45 2022] GET /compute/v2.1/servers/f61fd2c2-bca4-412d-93c3-5a3aee3a3b27 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:21:45.811088 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-64db48f6-d344-4342-9eb0-f3df85b39af9 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:45.812478 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-64db48f6-d344-4342-9eb0-f3df85b39af9 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:45.830725 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-64db48f6-d344-4342-9eb0-f3df85b39af9 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:45.835571 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-64db48f6-d344-4342-9eb0-f3df85b39af9 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:45.836416 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-64db48f6-d344-4342-9eb0-f3df85b39af9 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:45.837521 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-64db48f6-d344-4342-9eb0-f3df85b39af9 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:46.000343 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-64db48f6-d344-4342-9eb0-f3df85b39af9 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:46.009890 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-64db48f6-d344-4342-9eb0-f3df85b39af9 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1576 microversion: 2.1 time: 0.202870 May 27 15:21:46.024552 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 440/901] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:45 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1576 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:46.290590 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-351a46f4-ddb7-4454-a4c9-d5c2407368ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:46.291764 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-351a46f4-ddb7-4454-a4c9-d5c2407368ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:46.304118 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-351a46f4-ddb7-4454-a4c9-d5c2407368ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:46.310725 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-351a46f4-ddb7-4454-a4c9-d5c2407368ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:46.311803 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-351a46f4-ddb7-4454-a4c9-d5c2407368ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:46.312469 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-351a46f4-ddb7-4454-a4c9-d5c2407368ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:46.533230 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-351a46f4-ddb7-4454-a4c9-d5c2407368ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:46.543769 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-351a46f4-ddb7-4454-a4c9-d5c2407368ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:46.547569 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-351a46f4-ddb7-4454-a4c9-d5c2407368ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:46.549463 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-351a46f4-ddb7-4454-a4c9-d5c2407368ae tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1732 microversion: 2.20 time: 0.263697 May 27 15:21:46.550023 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 462/902] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:46 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1732 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:47.028584 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b72d902f-4503-46f7-b41d-c83a49e43431 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:47.029966 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b72d902f-4503-46f7-b41d-c83a49e43431 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:47.039432 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b72d902f-4503-46f7-b41d-c83a49e43431 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:47.040142 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b72d902f-4503-46f7-b41d-c83a49e43431 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:47.040934 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b72d902f-4503-46f7-b41d-c83a49e43431 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:47.041408 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b72d902f-4503-46f7-b41d-c83a49e43431 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:47.238248 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b72d902f-4503-46f7-b41d-c83a49e43431 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:47.248131 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b72d902f-4503-46f7-b41d-c83a49e43431 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1576 microversion: 2.1 time: 0.223851 May 27 15:21:47.248723 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 441/903] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:47 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1576 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:47.576985 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-fe51fb53-06ca-4d54-913d-869c6cddf8c5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:47.582586 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-fe51fb53-06ca-4d54-913d-869c6cddf8c5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:47.606079 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fe51fb53-06ca-4d54-913d-869c6cddf8c5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:47.606531 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fe51fb53-06ca-4d54-913d-869c6cddf8c5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:47.607699 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fe51fb53-06ca-4d54-913d-869c6cddf8c5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:47.615266 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-fe51fb53-06ca-4d54-913d-869c6cddf8c5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:47.888310 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-fe51fb53-06ca-4d54-913d-869c6cddf8c5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:47.901142 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-fe51fb53-06ca-4d54-913d-869c6cddf8c5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:47.904290 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-fe51fb53-06ca-4d54-913d-869c6cddf8c5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:47.907347 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-fe51fb53-06ca-4d54-913d-869c6cddf8c5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1732 microversion: 2.20 time: 0.336203 May 27 15:21:47.910083 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 463/904] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:47 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1732 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:48.268421 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-193a9980-386a-449b-9989-b75657f2f8ed tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:48.269239 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-193a9980-386a-449b-9989-b75657f2f8ed tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:48.283460 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-193a9980-386a-449b-9989-b75657f2f8ed tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:48.284157 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-193a9980-386a-449b-9989-b75657f2f8ed tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:48.285303 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-193a9980-386a-449b-9989-b75657f2f8ed tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:48.285983 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-193a9980-386a-449b-9989-b75657f2f8ed tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:48.558722 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-193a9980-386a-449b-9989-b75657f2f8ed tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:48.574082 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-193a9980-386a-449b-9989-b75657f2f8ed tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1576 microversion: 2.1 time: 0.311084 May 27 15:21:48.575685 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 442/905] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:48 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1576 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:48.928229 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b733b0c7-efef-4199-bbd0-3c68d78a91b4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:48.929551 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b733b0c7-efef-4199-bbd0-3c68d78a91b4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:48.942328 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b733b0c7-efef-4199-bbd0-3c68d78a91b4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:48.943187 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b733b0c7-efef-4199-bbd0-3c68d78a91b4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:48.947499 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b733b0c7-efef-4199-bbd0-3c68d78a91b4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:48.949106 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b733b0c7-efef-4199-bbd0-3c68d78a91b4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:49.595074 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d6b65d78-b0da-40dd-a208-a342188e789c tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:49.595563 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-d6b65d78-b0da-40dd-a208-a342188e789c tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:49.629542 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d6b65d78-b0da-40dd-a208-a342188e789c tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:49.631369 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d6b65d78-b0da-40dd-a208-a342188e789c tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:49.634052 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d6b65d78-b0da-40dd-a208-a342188e789c tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:49.635380 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d6b65d78-b0da-40dd-a208-a342188e789c tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:49.735981 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b733b0c7-efef-4199-bbd0-3c68d78a91b4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:49.747604 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b733b0c7-efef-4199-bbd0-3c68d78a91b4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:49.749768 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-b733b0c7-efef-4199-bbd0-3c68d78a91b4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:49.751456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b733b0c7-efef-4199-bbd0-3c68d78a91b4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1732 microversion: 2.20 time: 0.827799 May 27 15:21:49.753010 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 464/906] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:48 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1732 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:49.951539 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d6b65d78-b0da-40dd-a208-a342188e789c tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:49.960336 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-d6b65d78-b0da-40dd-a208-a342188e789c tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1576 microversion: 2.1 time: 0.371952 May 27 15:21:49.960936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 443/907] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:49 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1576 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:50.772258 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-da43efa2-69b4-49f0-933f-2da01acb94e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:50.773348 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-da43efa2-69b4-49f0-933f-2da01acb94e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:50.780826 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-da43efa2-69b4-49f0-933f-2da01acb94e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:50.781269 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-da43efa2-69b4-49f0-933f-2da01acb94e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:50.788025 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-da43efa2-69b4-49f0-933f-2da01acb94e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:50.790260 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-da43efa2-69b4-49f0-933f-2da01acb94e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:50.973471 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-da43efa2-69b4-49f0-933f-2da01acb94e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:50.983904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-36b30b79-d67e-44cc-9ccb-fd2b7d0a6e3d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:50.984779 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-da43efa2-69b4-49f0-933f-2da01acb94e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:50.985563 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-36b30b79-d67e-44cc-9ccb-fd2b7d0a6e3d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:50.986873 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-da43efa2-69b4-49f0-933f-2da01acb94e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:50.988240 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-da43efa2-69b4-49f0-933f-2da01acb94e9 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1732 microversion: 2.20 time: 0.221459 May 27 15:21:50.999047 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 465/908] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:50 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1732 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:51.003146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-36b30b79-d67e-44cc-9ccb-fd2b7d0a6e3d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:51.015364 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-36b30b79-d67e-44cc-9ccb-fd2b7d0a6e3d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:51.016340 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-36b30b79-d67e-44cc-9ccb-fd2b7d0a6e3d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:51.016793 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-36b30b79-d67e-44cc-9ccb-fd2b7d0a6e3d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:51.172560 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-36b30b79-d67e-44cc-9ccb-fd2b7d0a6e3d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:51.181333 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-36b30b79-d67e-44cc-9ccb-fd2b7d0a6e3d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1576 microversion: 2.1 time: 0.207654 May 27 15:21:51.187114 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 444/909] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:50 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:51.861667 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e8fcf852-e5cc-41ed-93d0-c0bc010aa9de tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1723551787", "imageRef": "a9407644-1f68-43e6-beb1-ce2085766180", "flavorRef": "452"}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:51.917501 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.network.neutron [None req-e8fcf852-e5cc-41ed-93d0-c0bc010aa9de tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] validate_networks() for None {{(pid=117742) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:21:52.013075 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d16be454-3ecd-45d7-a373-15f94aa735df tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:52.013807 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-d16be454-3ecd-45d7-a373-15f94aa735df tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:52.024481 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d16be454-3ecd-45d7-a373-15f94aa735df tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:52.025229 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d16be454-3ecd-45d7-a373-15f94aa735df tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:52.026197 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d16be454-3ecd-45d7-a373-15f94aa735df tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:52.026875 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d16be454-3ecd-45d7-a373-15f94aa735df tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:52.335685 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d16be454-3ecd-45d7-a373-15f94aa735df tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:52.355593 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d16be454-3ecd-45d7-a373-15f94aa735df tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:52.357116 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d16be454-3ecd-45d7-a373-15f94aa735df tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:52.357351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-e8fcf852-e5cc-41ed-93d0-c0bc010aa9de tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Flavor limits 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:21:52.358047 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-e8fcf852-e5cc-41ed-93d0-c0bc010aa9de tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Image limits 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:21:52.358596 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-e8fcf852-e5cc-41ed-93d0-c0bc010aa9de tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Flavor pref 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:21:52.359097 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-e8fcf852-e5cc-41ed-93d0-c0bc010aa9de tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Image pref 0:0:0 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:21:52.359606 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.virt.hardware [None req-e8fcf852-e5cc-41ed-93d0-c0bc010aa9de tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117742) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:21:52.368330 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-d16be454-3ecd-45d7-a373-15f94aa735df tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1732 microversion: 2.20 time: 0.359299 May 27 15:21:52.369938 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e8fcf852-e5cc-41ed-93d0-c0bc010aa9de tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:52.370437 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e8fcf852-e5cc-41ed-93d0-c0bc010aa9de tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:52.371359 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e8fcf852-e5cc-41ed-93d0-c0bc010aa9de tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:52.371787 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e8fcf852-e5cc-41ed-93d0-c0bc010aa9de tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:52.374767 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 445/910] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:52 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1732 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:52.379960 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-0260f9a7-242b-4bad-99c6-bee598f357e4 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:52.380563 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-0260f9a7-242b-4bad-99c6-bee598f357e4 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:52.380816 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:52.401592 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-e8fcf852-e5cc-41ed-93d0-c0bc010aa9de tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Getting quotas for project 9c3ebf345dbe46f7a137e1a62dee5f33. Resources: {'cores', 'ram', 'instances'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:21:52.401879 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0260f9a7-242b-4bad-99c6-bee598f357e4 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:52.402607 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0260f9a7-242b-4bad-99c6-bee598f357e4 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:52.403751 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0260f9a7-242b-4bad-99c6-bee598f357e4 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:52.404391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0260f9a7-242b-4bad-99c6-bee598f357e4 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:52.411066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-e8fcf852-e5cc-41ed-93d0-c0bc010aa9de tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Getting quotas for user 4cb25251cbd442a89f0a73bf35e76c3c and project 9c3ebf345dbe46f7a137e1a62dee5f33. Resources: {'cores', 'ram', 'instances'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:21:52.438896 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e8fcf852-e5cc-41ed-93d0-c0bc010aa9de tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Going to run 1 instances... {{(pid=117742) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:21:52.441491 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e8fcf852-e5cc-41ed-93d0-c0bc010aa9de tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] [instance: 240252a3-813b-4e1c-bd56-efa9695c9f56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9407644-1f68-43e6-beb1-ce2085766180',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117742) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:21:52.499667 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-e8fcf852-e5cc-41ed-93d0-c0bc010aa9de tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642100 May 27 15:21:52.500916 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 466/911] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 15:21:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:21:52.514503 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-4091b5ac-73b8-426c-aa7a-0e29d51d47fe tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:52.516118 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-4091b5ac-73b8-426c-aa7a-0e29d51d47fe tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] [instance: 240252a3-813b-4e1c-bd56-efa9695c9f56] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:52.624313 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-4091b5ac-73b8-426c-aa7a-0e29d51d47fe tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb25251cbd442a89f0a73bf35e76c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3ebf345dbe46f7a137e1a62dee5f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:52.632324 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-4091b5ac-73b8-426c-aa7a-0e29d51d47fe tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] 10.222.0.50 "GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56" status: 200 len: 1215 microversion: 2.1 time: 0.122641 May 27 15:21:52.642493 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 467/912] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:52 2022] GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56 => generated 1215 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:52.706103 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-0260f9a7-242b-4bad-99c6-bee598f357e4 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:52.738042 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-0260f9a7-242b-4bad-99c6-bee598f357e4 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1576 microversion: 2.1 time: 0.361962 May 27 15:21:52.745834 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 446/913] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:52 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1576 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:53.388904 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-40d5898e-a90c-49f2-b71c-7dd040f0c5f3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:53.389756 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-40d5898e-a90c-49f2-b71c-7dd040f0c5f3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:53.401281 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-40d5898e-a90c-49f2-b71c-7dd040f0c5f3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:53.406699 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-40d5898e-a90c-49f2-b71c-7dd040f0c5f3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:53.407770 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-40d5898e-a90c-49f2-b71c-7dd040f0c5f3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:53.408548 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-40d5898e-a90c-49f2-b71c-7dd040f0c5f3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:53.636531 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-40d5898e-a90c-49f2-b71c-7dd040f0c5f3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:53.646495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-40d5898e-a90c-49f2-b71c-7dd040f0c5f3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:53.649346 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-40d5898e-a90c-49f2-b71c-7dd040f0c5f3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:53.649511 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-4caa85a1-5c04-4b49-a4e9-e90939db6ae3 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:53.649997 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-4caa85a1-5c04-4b49-a4e9-e90939db6ae3 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] [instance: 240252a3-813b-4e1c-bd56-efa9695c9f56] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:53.651388 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-40d5898e-a90c-49f2-b71c-7dd040f0c5f3 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1732 microversion: 2.20 time: 0.267346 May 27 15:21:53.663903 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:53.663903 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4caa85a1-5c04-4b49-a4e9-e90939db6ae3 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:53.664273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4caa85a1-5c04-4b49-a4e9-e90939db6ae3 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:53.664870 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4caa85a1-5c04-4b49-a4e9-e90939db6ae3 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:53.667442 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4caa85a1-5c04-4b49-a4e9-e90939db6ae3 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:53.669793 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 468/914] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:53 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1732 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:53.758804 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-112c1adc-2147-4eb6-aa11-751d9973266d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:53.759728 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-112c1adc-2147-4eb6-aa11-751d9973266d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:53.773619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-4caa85a1-5c04-4b49-a4e9-e90939db6ae3 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb25251cbd442a89f0a73bf35e76c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3ebf345dbe46f7a137e1a62dee5f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:53.778190 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-112c1adc-2147-4eb6-aa11-751d9973266d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:53.779233 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-112c1adc-2147-4eb6-aa11-751d9973266d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:53.783147 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-4caa85a1-5c04-4b49-a4e9-e90939db6ae3 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] 10.222.0.50 "GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56" status: 200 len: 1219 microversion: 2.1 time: 0.136903 May 27 15:21:53.789000 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-112c1adc-2147-4eb6-aa11-751d9973266d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:53.791644 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-112c1adc-2147-4eb6-aa11-751d9973266d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:53.792411 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 447/915] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:53 2022] GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:53.953375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-112c1adc-2147-4eb6-aa11-751d9973266d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:53.962147 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-112c1adc-2147-4eb6-aa11-751d9973266d tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1576 microversion: 2.1 time: 0.209901 May 27 15:21:53.962737 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 469/916] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:53 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:54.677315 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-8a07e4ed-e895-4b1b-93d7-06d418351ea4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:54.678018 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-8a07e4ed-e895-4b1b-93d7-06d418351ea4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:54.684898 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8a07e4ed-e895-4b1b-93d7-06d418351ea4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:54.685267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8a07e4ed-e895-4b1b-93d7-06d418351ea4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:54.686032 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8a07e4ed-e895-4b1b-93d7-06d418351ea4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:54.686472 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8a07e4ed-e895-4b1b-93d7-06d418351ea4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:54.800560 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-11a7722d-34e0-4eba-92c0-37c9afe4cb51 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:54.801520 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-11a7722d-34e0-4eba-92c0-37c9afe4cb51 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] [instance: 240252a3-813b-4e1c-bd56-efa9695c9f56] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:54.812520 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-11a7722d-34e0-4eba-92c0-37c9afe4cb51 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:54.812944 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-11a7722d-34e0-4eba-92c0-37c9afe4cb51 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:54.813734 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-11a7722d-34e0-4eba-92c0-37c9afe4cb51 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:54.814361 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-11a7722d-34e0-4eba-92c0-37c9afe4cb51 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:54.825149 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-8a07e4ed-e895-4b1b-93d7-06d418351ea4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:54.835640 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-8a07e4ed-e895-4b1b-93d7-06d418351ea4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:54.837645 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-8a07e4ed-e895-4b1b-93d7-06d418351ea4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:54.839521 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-8a07e4ed-e895-4b1b-93d7-06d418351ea4 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1732 microversion: 2.20 time: 0.165922 May 27 15:21:54.843573 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 448/917] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:54 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:54.879722 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-11a7722d-34e0-4eba-92c0-37c9afe4cb51 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb25251cbd442a89f0a73bf35e76c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3ebf345dbe46f7a137e1a62dee5f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:54.894560 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-11a7722d-34e0-4eba-92c0-37c9afe4cb51 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] 10.222.0.50 "GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56" status: 200 len: 1219 microversion: 2.1 time: 0.091740 May 27 15:21:54.894560 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 470/918] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:54 2022] GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:54.980203 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a6c25294-8e4a-4840-ac02-44e6fd419da1 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:54.980904 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a6c25294-8e4a-4840-ac02-44e6fd419da1 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:54.989174 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a6c25294-8e4a-4840-ac02-44e6fd419da1 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:54.989627 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a6c25294-8e4a-4840-ac02-44e6fd419da1 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:54.990451 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a6c25294-8e4a-4840-ac02-44e6fd419da1 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:54.990910 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a6c25294-8e4a-4840-ac02-44e6fd419da1 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:55.130388 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a6c25294-8e4a-4840-ac02-44e6fd419da1 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:55.139259 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a6c25294-8e4a-4840-ac02-44e6fd419da1 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1576 microversion: 2.1 time: 0.163008 May 27 15:21:55.139841 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 449/919] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:54 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:55.733495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-f8604f0c-8fff-4490-bcee-6038396db9a6 req-94451502-0008-4bd2-80d3-ed22c51ab40b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e4355e-ea71-44c5-90ae-0ec0406a5d6e", "name": "network-vif-plugged", "status": "completed", "tag": "58c057d0-cc07-4dc4-ab97-0024ba4d6dfd"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:55.750201 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-f8604f0c-8fff-4490-bcee-6038396db9a6 req-94451502-0008-4bd2-80d3-ed22c51ab40b service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:55.750201 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-f8604f0c-8fff-4490-bcee-6038396db9a6 req-94451502-0008-4bd2-80d3-ed22c51ab40b service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:55.773364 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-f8604f0c-8fff-4490-bcee-6038396db9a6 req-94451502-0008-4bd2-80d3-ed22c51ab40b service nova] Creating event network-vif-plugged:58c057d0-cc07-4dc4-ab97-0024ba4d6dfd for instance 16e4355e-ea71-44c5-90ae-0ec0406a5d6e on hv-cinder-84254 May 27 15:21:55.781132 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-f8604f0c-8fff-4490-bcee-6038396db9a6 req-94451502-0008-4bd2-80d3-ed22c51ab40b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051249 May 27 15:21:55.782100 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 471/920] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:55.858510 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-6ba11bec-e3ee-42ee-bf28-6535f82baf0e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:55.859944 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-6ba11bec-e3ee-42ee-bf28-6535f82baf0e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:55.869641 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6ba11bec-e3ee-42ee-bf28-6535f82baf0e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:55.882762 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6ba11bec-e3ee-42ee-bf28-6535f82baf0e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:55.885148 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6ba11bec-e3ee-42ee-bf28-6535f82baf0e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:55.886291 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6ba11bec-e3ee-42ee-bf28-6535f82baf0e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:55.907259 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-2863ecd5-882a-4cf4-8b27-f95c2e8b3780 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:55.908669 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-2863ecd5-882a-4cf4-8b27-f95c2e8b3780 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] [instance: 240252a3-813b-4e1c-bd56-efa9695c9f56] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:55.916481 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2863ecd5-882a-4cf4-8b27-f95c2e8b3780 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:55.917028 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2863ecd5-882a-4cf4-8b27-f95c2e8b3780 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:55.917793 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2863ecd5-882a-4cf4-8b27-f95c2e8b3780 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:55.918230 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2863ecd5-882a-4cf4-8b27-f95c2e8b3780 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:56.013112 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-2863ecd5-882a-4cf4-8b27-f95c2e8b3780 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb25251cbd442a89f0a73bf35e76c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3ebf345dbe46f7a137e1a62dee5f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:56.032281 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-2863ecd5-882a-4cf4-8b27-f95c2e8b3780 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] 10.222.0.50 "GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56" status: 200 len: 1285 microversion: 2.1 time: 0.128387 May 27 15:21:56.045363 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 472/921] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:55 2022] GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56 => generated 1285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:56.157495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-44647eef-2156-4e3e-b7a2-b7fe57eda8ac tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:56.158145 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-44647eef-2156-4e3e-b7a2-b7fe57eda8ac tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:56.165673 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-44647eef-2156-4e3e-b7a2-b7fe57eda8ac tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:56.166500 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-44647eef-2156-4e3e-b7a2-b7fe57eda8ac tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:56.167667 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-44647eef-2156-4e3e-b7a2-b7fe57eda8ac tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:56.168379 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-44647eef-2156-4e3e-b7a2-b7fe57eda8ac tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:56.176555 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-6ba11bec-e3ee-42ee-bf28-6535f82baf0e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:56.189692 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-6ba11bec-e3ee-42ee-bf28-6535f82baf0e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:56.192644 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-6ba11bec-e3ee-42ee-bf28-6535f82baf0e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:56.194887 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-6ba11bec-e3ee-42ee-bf28-6535f82baf0e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1732 microversion: 2.20 time: 0.340748 May 27 15:21:56.195931 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 450/922] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:55 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1732 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:56.326609 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-44647eef-2156-4e3e-b7a2-b7fe57eda8ac tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:56.335003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-44647eef-2156-4e3e-b7a2-b7fe57eda8ac tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1576 microversion: 2.1 time: 0.181531 May 27 15:21:56.335624 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 473/923] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:56 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:57.050781 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-1e524131-abe7-404a-9d03-43aaba72e96a tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:57.051471 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-1e524131-abe7-404a-9d03-43aaba72e96a tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] [instance: 240252a3-813b-4e1c-bd56-efa9695c9f56] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:57.059015 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1e524131-abe7-404a-9d03-43aaba72e96a tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:57.059468 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1e524131-abe7-404a-9d03-43aaba72e96a tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:57.060430 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1e524131-abe7-404a-9d03-43aaba72e96a tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:57.061028 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1e524131-abe7-404a-9d03-43aaba72e96a tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:57.212951 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-1e524131-abe7-404a-9d03-43aaba72e96a tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb25251cbd442a89f0a73bf35e76c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3ebf345dbe46f7a137e1a62dee5f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:57.215846 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-9f784730-f88e-4a2a-aa84-9a0e435fe137 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:57.217540 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-9f784730-f88e-4a2a-aa84-9a0e435fe137 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:57.226091 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9f784730-f88e-4a2a-aa84-9a0e435fe137 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:57.226585 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9f784730-f88e-4a2a-aa84-9a0e435fe137 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:57.226729 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-1e524131-abe7-404a-9d03-43aaba72e96a tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] 10.222.0.50 "GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56" status: 200 len: 1315 microversion: 2.1 time: 0.174867 May 27 15:21:57.227738 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9f784730-f88e-4a2a-aa84-9a0e435fe137 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:57.228356 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9f784730-f88e-4a2a-aa84-9a0e435fe137 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:57.234908 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 451/924] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:57 2022] GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:57.353105 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-ab6d1611-c698-46ba-9091-9503006c7e01 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:57.353984 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-ab6d1611-c698-46ba-9091-9503006c7e01 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:57.360767 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ab6d1611-c698-46ba-9091-9503006c7e01 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:57.361877 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ab6d1611-c698-46ba-9091-9503006c7e01 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:57.362912 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ab6d1611-c698-46ba-9091-9503006c7e01 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:57.363850 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ab6d1611-c698-46ba-9091-9503006c7e01 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:57.389963 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-9f784730-f88e-4a2a-aa84-9a0e435fe137 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:57.399565 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-9f784730-f88e-4a2a-aa84-9a0e435fe137 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:57.401448 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-9f784730-f88e-4a2a-aa84-9a0e435fe137 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:57.403125 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-9f784730-f88e-4a2a-aa84-9a0e435fe137 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1732 microversion: 2.20 time: 0.194182 May 27 15:21:57.420176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 474/925] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:57 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1732 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:21:57.534701 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-ab6d1611-c698-46ba-9091-9503006c7e01 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:57.542538 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-ab6d1611-c698-46ba-9091-9503006c7e01 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1576 microversion: 2.1 time: 0.193850 May 27 15:21:57.543235 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 452/926] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:57 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1576 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:21:57.859913 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-56310d2e-4ef6-4564-b54a-4ab7adbdf831 req-00aa8011-a844-4c63-8ca3-93f84eb47d43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "240252a3-813b-4e1c-bd56-efa9695c9f56", "tag": "79a043b7-5f2a-464b-9615-08fee945a19e"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:57.868783 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-56310d2e-4ef6-4564-b54a-4ab7adbdf831 req-00aa8011-a844-4c63-8ca3-93f84eb47d43 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:57.869312 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-56310d2e-4ef6-4564-b54a-4ab7adbdf831 req-00aa8011-a844-4c63-8ca3-93f84eb47d43 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:57.888601 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-56310d2e-4ef6-4564-b54a-4ab7adbdf831 req-00aa8011-a844-4c63-8ca3-93f84eb47d43 service nova] Creating event network-changed:79a043b7-5f2a-464b-9615-08fee945a19e for instance 240252a3-813b-4e1c-bd56-efa9695c9f56 on hv-cinder-84254 May 27 15:21:57.893568 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-56310d2e-4ef6-4564-b54a-4ab7adbdf831 req-00aa8011-a844-4c63-8ca3-93f84eb47d43 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037318 May 27 15:21:57.901671 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 475/927] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:21:58.246130 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-ead4290a-2060-454e-8b81-a30c594d260d tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:58.246779 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-ead4290a-2060-454e-8b81-a30c594d260d tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] [instance: 240252a3-813b-4e1c-bd56-efa9695c9f56] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:58.254826 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ead4290a-2060-454e-8b81-a30c594d260d tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:58.255308 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ead4290a-2060-454e-8b81-a30c594d260d tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:58.256673 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ead4290a-2060-454e-8b81-a30c594d260d tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:58.257115 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ead4290a-2060-454e-8b81-a30c594d260d tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:58.389144 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-ead4290a-2060-454e-8b81-a30c594d260d tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb25251cbd442a89f0a73bf35e76c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3ebf345dbe46f7a137e1a62dee5f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:58.397243 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-ead4290a-2060-454e-8b81-a30c594d260d tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] 10.222.0.50 "GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56" status: 200 len: 1315 microversion: 2.1 time: 0.154488 May 27 15:21:58.397974 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 453/928] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:58 2022] GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:58.422544 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-0d6bc41e-24a2-412b-8b27-031ab6bb560f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:58.423290 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-0d6bc41e-24a2-412b-8b27-031ab6bb560f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:58.429685 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0d6bc41e-24a2-412b-8b27-031ab6bb560f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:58.430134 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0d6bc41e-24a2-412b-8b27-031ab6bb560f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:58.430930 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0d6bc41e-24a2-412b-8b27-031ab6bb560f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:58.431377 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0d6bc41e-24a2-412b-8b27-031ab6bb560f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:58.559618 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-6819ef17-1e32-42a1-b06a-7b00db83c845 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:58.560238 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-6819ef17-1e32-42a1-b06a-7b00db83c845 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:58.566578 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6819ef17-1e32-42a1-b06a-7b00db83c845 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:58.567260 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6819ef17-1e32-42a1-b06a-7b00db83c845 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:58.568200 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6819ef17-1e32-42a1-b06a-7b00db83c845 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:58.569301 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6819ef17-1e32-42a1-b06a-7b00db83c845 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:58.576021 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-0d6bc41e-24a2-412b-8b27-031ab6bb560f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:58.590231 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-0d6bc41e-24a2-412b-8b27-031ab6bb560f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:58.592718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-0d6bc41e-24a2-412b-8b27-031ab6bb560f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:58.594171 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-0d6bc41e-24a2-412b-8b27-031ab6bb560f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1732 microversion: 2.20 time: 0.176481 May 27 15:21:58.596216 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 476/929] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:58 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:21:58.714365 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-6819ef17-1e32-42a1-b06a-7b00db83c845 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:58.725932 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-6819ef17-1e32-42a1-b06a-7b00db83c845 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1563 microversion: 2.1 time: 0.169159 May 27 15:21:58.727283 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 454/930] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:58 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:59.414347 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-4b19aa7f-3e15-4bc2-a0ac-779a3bac32a1 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:59.415043 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-4b19aa7f-3e15-4bc2-a0ac-779a3bac32a1 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] [instance: 240252a3-813b-4e1c-bd56-efa9695c9f56] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:59.421541 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4b19aa7f-3e15-4bc2-a0ac-779a3bac32a1 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.421989 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4b19aa7f-3e15-4bc2-a0ac-779a3bac32a1 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.422748 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4b19aa7f-3e15-4bc2-a0ac-779a3bac32a1 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.423327 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4b19aa7f-3e15-4bc2-a0ac-779a3bac32a1 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.557641 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-4b19aa7f-3e15-4bc2-a0ac-779a3bac32a1 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb25251cbd442a89f0a73bf35e76c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3ebf345dbe46f7a137e1a62dee5f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:59.565127 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-4b19aa7f-3e15-4bc2-a0ac-779a3bac32a1 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] 10.222.0.50 "GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56" status: 200 len: 1315 microversion: 2.1 time: 0.155216 May 27 15:21:59.565705 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 477/931] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:21:59 2022] GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:21:59.614234 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-45c18c4a-2548-49d8-8179-8f1e37be4260 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:21:59.614884 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-45c18c4a-2548-49d8-8179-8f1e37be4260 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:21:59.621968 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-45c18c4a-2548-49d8-8179-8f1e37be4260 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.622423 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-45c18c4a-2548-49d8-8179-8f1e37be4260 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.623218 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-45c18c4a-2548-49d8-8179-8f1e37be4260 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.623657 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-45c18c4a-2548-49d8-8179-8f1e37be4260 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.642280 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=100 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:21:59.738947 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-bd7f71cb-650c-453a-ae2a-8b9816dadf65 req-12ecdfbf-1fc0-43b4-8a5a-9c591278f29a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1c52039-f595-4f22-9df9-ea3a999f55fe", "name": "network-vif-plugged", "status": "completed", "tag": "00ae88d7-8fbc-40d5-aefb-819837b95c30"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:21:59.748207 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-bd7f71cb-650c-453a-ae2a-8b9816dadf65 req-12ecdfbf-1fc0-43b4-8a5a-9c591278f29a service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:21:59.748650 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-bd7f71cb-650c-453a-ae2a-8b9816dadf65 req-12ecdfbf-1fc0-43b4-8a5a-9c591278f29a service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:21:59.759013 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-45c18c4a-2548-49d8-8179-8f1e37be4260 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:59.761819 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-bd7f71cb-650c-453a-ae2a-8b9816dadf65 req-12ecdfbf-1fc0-43b4-8a5a-9c591278f29a service nova] Creating event network-vif-plugged:00ae88d7-8fbc-40d5-aefb-819837b95c30 for instance f1c52039-f595-4f22-9df9-ea3a999f55fe on hv-cinder-84254 May 27 15:21:59.766768 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-bd7f71cb-650c-453a-ae2a-8b9816dadf65 req-12ecdfbf-1fc0-43b4-8a5a-9c591278f29a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031616 May 27 15:21:59.767495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 478/932] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:21:59.769519 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-45c18c4a-2548-49d8-8179-8f1e37be4260 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:59.771291 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-45c18c4a-2548-49d8-8179-8f1e37be4260 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:21:59.773043 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-45c18c4a-2548-49d8-8179-8f1e37be4260 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1732 microversion: 2.20 time: 0.163114 May 27 15:21:59.774017 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 455/933] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:21:59 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:00.583402 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-19f5516c-6aba-4256-8006-328087a59182 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:00.584165 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-19f5516c-6aba-4256-8006-328087a59182 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] [instance: 240252a3-813b-4e1c-bd56-efa9695c9f56] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:00.590354 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-19f5516c-6aba-4256-8006-328087a59182 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:00.590802 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-19f5516c-6aba-4256-8006-328087a59182 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:00.591596 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-19f5516c-6aba-4256-8006-328087a59182 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:00.592036 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-19f5516c-6aba-4256-8006-328087a59182 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:00.740017 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-19f5516c-6aba-4256-8006-328087a59182 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb25251cbd442a89f0a73bf35e76c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3ebf345dbe46f7a137e1a62dee5f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:00.747741 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-19f5516c-6aba-4256-8006-328087a59182 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] 10.222.0.50 "GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56" status: 200 len: 1315 microversion: 2.1 time: 0.168955 May 27 15:22:00.748332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 479/934] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:00 2022] GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:00.792335 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-1220a96e-5419-4037-ae23-48d7434f7a02 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:00.793136 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-1220a96e-5419-4037-ae23-48d7434f7a02 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:00.801351 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1220a96e-5419-4037-ae23-48d7434f7a02 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:00.801805 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1220a96e-5419-4037-ae23-48d7434f7a02 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:00.802634 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1220a96e-5419-4037-ae23-48d7434f7a02 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:00.803101 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-1220a96e-5419-4037-ae23-48d7434f7a02 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:00.938011 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-1220a96e-5419-4037-ae23-48d7434f7a02 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:00.946791 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-1220a96e-5419-4037-ae23-48d7434f7a02 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:00.948344 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-1220a96e-5419-4037-ae23-48d7434f7a02 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:00.949537 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-1220a96e-5419-4037-ae23-48d7434f7a02 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1732 microversion: 2.20 time: 0.161445 May 27 15:22:00.950111 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 456/935] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:22:00 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 15:22:01.764601 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ca791d69-e427-4185-955d-f3bbc52b3b3a tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:01.765303 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ca791d69-e427-4185-955d-f3bbc52b3b3a tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] [instance: 240252a3-813b-4e1c-bd56-efa9695c9f56] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:01.773424 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ca791d69-e427-4185-955d-f3bbc52b3b3a tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:01.774254 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ca791d69-e427-4185-955d-f3bbc52b3b3a tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:01.775054 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ca791d69-e427-4185-955d-f3bbc52b3b3a tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:01.775489 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-ca791d69-e427-4185-955d-f3bbc52b3b3a tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:01.920979 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-ca791d69-e427-4185-955d-f3bbc52b3b3a tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb25251cbd442a89f0a73bf35e76c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3ebf345dbe46f7a137e1a62dee5f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:01.929324 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ca791d69-e427-4185-955d-f3bbc52b3b3a tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] 10.222.0.50 "GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56" status: 200 len: 1315 microversion: 2.1 time: 0.168493 May 27 15:22:01.929915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 480/936] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:01 2022] GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:01.968745 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d47014da-d54f-4be8-b6b5-ff9c330bdf8d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:01.969623 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-d47014da-d54f-4be8-b6b5-ff9c330bdf8d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:01.976826 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d47014da-d54f-4be8-b6b5-ff9c330bdf8d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:01.977281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d47014da-d54f-4be8-b6b5-ff9c330bdf8d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:01.978101 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d47014da-d54f-4be8-b6b5-ff9c330bdf8d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:01.978777 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d47014da-d54f-4be8-b6b5-ff9c330bdf8d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:02.124980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d47014da-d54f-4be8-b6b5-ff9c330bdf8d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:02.134759 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d47014da-d54f-4be8-b6b5-ff9c330bdf8d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:02.136281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d47014da-d54f-4be8-b6b5-ff9c330bdf8d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:02.137442 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-d47014da-d54f-4be8-b6b5-ff9c330bdf8d tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1732 microversion: 2.20 time: 0.172788 May 27 15:22:02.138209 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 457/937] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:22:01 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:02.946213 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-6d11c603-d6d5-427f-9a95-80d2bdb99eae tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:02.951979 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-6d11c603-d6d5-427f-9a95-80d2bdb99eae tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] [instance: 240252a3-813b-4e1c-bd56-efa9695c9f56] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:02.951979 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=2 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:02.951979 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=8 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:02.956507 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6d11c603-d6d5-427f-9a95-80d2bdb99eae tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:02.956967 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6d11c603-d6d5-427f-9a95-80d2bdb99eae tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:02.957758 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6d11c603-d6d5-427f-9a95-80d2bdb99eae tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:02.958250 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6d11c603-d6d5-427f-9a95-80d2bdb99eae tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:03.112899 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6d11c603-d6d5-427f-9a95-80d2bdb99eae tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb25251cbd442a89f0a73bf35e76c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3ebf345dbe46f7a137e1a62dee5f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:03.121103 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-6d11c603-d6d5-427f-9a95-80d2bdb99eae tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] 10.222.0.50 "GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56" status: 200 len: 1315 microversion: 2.1 time: 0.179159 May 27 15:22:03.121705 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 481/938] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:02 2022] GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:03.156591 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-eccd8e71-c8c0-4c3b-a011-29da12398663 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:03.157207 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-eccd8e71-c8c0-4c3b-a011-29da12398663 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:03.163923 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-eccd8e71-c8c0-4c3b-a011-29da12398663 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:03.164403 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-eccd8e71-c8c0-4c3b-a011-29da12398663 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:03.165170 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-eccd8e71-c8c0-4c3b-a011-29da12398663 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:03.165609 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-eccd8e71-c8c0-4c3b-a011-29da12398663 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:03.297744 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-eccd8e71-c8c0-4c3b-a011-29da12398663 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:03.306314 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-eccd8e71-c8c0-4c3b-a011-29da12398663 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:03.307834 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-eccd8e71-c8c0-4c3b-a011-29da12398663 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:03.308981 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-eccd8e71-c8c0-4c3b-a011-29da12398663 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1719 microversion: 2.20 time: 0.156332 May 27 15:22:03.309537 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 458/939] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:22:03 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:03.785117 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-6ab36762-62ba-4568-9275-4ab4b7cf165d req-5be6178a-867a-4442-b93c-15620d809e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "240252a3-813b-4e1c-bd56-efa9695c9f56", "name": "network-vif-plugged", "status": "completed", "tag": "79a043b7-5f2a-464b-9615-08fee945a19e"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:03.793927 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-6ab36762-62ba-4568-9275-4ab4b7cf165d req-5be6178a-867a-4442-b93c-15620d809e3b service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:03.794481 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-6ab36762-62ba-4568-9275-4ab4b7cf165d req-5be6178a-867a-4442-b93c-15620d809e3b service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:03.807206 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-6ab36762-62ba-4568-9275-4ab4b7cf165d req-5be6178a-867a-4442-b93c-15620d809e3b service nova] Creating event network-vif-plugged:79a043b7-5f2a-464b-9615-08fee945a19e for instance 240252a3-813b-4e1c-bd56-efa9695c9f56 on hv-cinder-84254 May 27 15:22:03.812320 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-6ab36762-62ba-4568-9275-4ab4b7cf165d req-5be6178a-867a-4442-b93c-15620d809e3b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031092 May 27 15:22:03.813072 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 482/940] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:04.137723 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-19a5404c-5b32-41e6-bc42-fefa6c64d7a4 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:04.138332 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-19a5404c-5b32-41e6-bc42-fefa6c64d7a4 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] [instance: 240252a3-813b-4e1c-bd56-efa9695c9f56] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:04.144288 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-19a5404c-5b32-41e6-bc42-fefa6c64d7a4 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:04.144737 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-19a5404c-5b32-41e6-bc42-fefa6c64d7a4 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:04.145500 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-19a5404c-5b32-41e6-bc42-fefa6c64d7a4 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:04.145933 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-19a5404c-5b32-41e6-bc42-fefa6c64d7a4 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:04.275214 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-19a5404c-5b32-41e6-bc42-fefa6c64d7a4 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb25251cbd442a89f0a73bf35e76c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3ebf345dbe46f7a137e1a62dee5f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:04.282670 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-19a5404c-5b32-41e6-bc42-fefa6c64d7a4 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] 10.222.0.50 "GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56" status: 200 len: 1315 microversion: 2.1 time: 0.148705 May 27 15:22:04.283619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 459/941] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:04 2022] GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:05.301661 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f09cec33-5646-451d-882f-993f9c355271 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:05.302449 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f09cec33-5646-451d-882f-993f9c355271 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] [instance: 240252a3-813b-4e1c-bd56-efa9695c9f56] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:05.309898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f09cec33-5646-451d-882f-993f9c355271 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:05.310348 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f09cec33-5646-451d-882f-993f9c355271 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:05.311158 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f09cec33-5646-451d-882f-993f9c355271 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:05.311593 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f09cec33-5646-451d-882f-993f9c355271 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:05.455605 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f09cec33-5646-451d-882f-993f9c355271 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb25251cbd442a89f0a73bf35e76c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3ebf345dbe46f7a137e1a62dee5f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:05.463651 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f09cec33-5646-451d-882f-993f9c355271 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] 10.222.0.50 "GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56" status: 200 len: 1465 microversion: 2.1 time: 0.166737 May 27 15:22:05.464232 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 483/942] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:05 2022] GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56 => generated 1465 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:05.504162 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-39551481-5f95-4c84-888c-098c55195ef0 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:05.504657 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-39551481-5f95-4c84-888c-098c55195ef0 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] [instance: 240252a3-813b-4e1c-bd56-efa9695c9f56] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:05.511929 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-39551481-5f95-4c84-888c-098c55195ef0 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:05.512379 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-39551481-5f95-4c84-888c-098c55195ef0 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:05.513154 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-39551481-5f95-4c84-888c-098c55195ef0 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:05.513599 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-39551481-5f95-4c84-888c-098c55195ef0 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:05.546217 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-39551481-5f95-4c84-888c-098c55195ef0 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] [instance: 240252a3-813b-4e1c-bd56-efa9695c9f56] Going to try to terminate instance {{(pid=117743) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:22:05.642506 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-39551481-5f95-4c84-888c-098c55195ef0 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] 10.222.0.50 "DELETE /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56" status: 204 len: 0 microversion: 2.1 time: 0.141985 May 27 15:22:05.643146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 460/943] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:22:05 2022] DELETE /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:22:05.651992 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-4cc6d2ed-7377-49c5-931a-7ea0e8ba5d4e tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:05.652598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-4cc6d2ed-7377-49c5-931a-7ea0e8ba5d4e tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] [instance: 240252a3-813b-4e1c-bd56-efa9695c9f56] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:05.658546 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4cc6d2ed-7377-49c5-931a-7ea0e8ba5d4e tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:05.659059 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4cc6d2ed-7377-49c5-931a-7ea0e8ba5d4e tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:05.659815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4cc6d2ed-7377-49c5-931a-7ea0e8ba5d4e tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:05.660245 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4cc6d2ed-7377-49c5-931a-7ea0e8ba5d4e tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:05.801176 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-4cc6d2ed-7377-49c5-931a-7ea0e8ba5d4e tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb25251cbd442a89f0a73bf35e76c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3ebf345dbe46f7a137e1a62dee5f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:05.811094 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-4cc6d2ed-7377-49c5-931a-7ea0e8ba5d4e tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] 10.222.0.50 "GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56" status: 200 len: 1471 microversion: 2.1 time: 0.163502 May 27 15:22:05.811684 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 484/944] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:05 2022] GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:06.829400 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9fcbefa9-abca-460e-888d-fd9aaa3a5835 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:06.830138 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9fcbefa9-abca-460e-888d-fd9aaa3a5835 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] [instance: 240252a3-813b-4e1c-bd56-efa9695c9f56] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:06.837527 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9fcbefa9-abca-460e-888d-fd9aaa3a5835 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:06.837975 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9fcbefa9-abca-460e-888d-fd9aaa3a5835 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:06.838744 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9fcbefa9-abca-460e-888d-fd9aaa3a5835 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:06.839224 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9fcbefa9-abca-460e-888d-fd9aaa3a5835 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:06.985299 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9fcbefa9-abca-460e-888d-fd9aaa3a5835 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb25251cbd442a89f0a73bf35e76c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3ebf345dbe46f7a137e1a62dee5f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:06.993252 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9fcbefa9-abca-460e-888d-fd9aaa3a5835 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] 10.222.0.50 "GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56" status: 200 len: 1471 microversion: 2.1 time: 0.168058 May 27 15:22:06.993876 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 461/945] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:06 2022] GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56 => generated 1471 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:07.665170 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-f55a7b29-e0a6-4e1f-b683-5bddbeb55e0f req-31334a3f-f3ca-4058-a065-a02e10884c5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "240252a3-813b-4e1c-bd56-efa9695c9f56", "name": "network-vif-deleted", "tag": "79a043b7-5f2a-464b-9615-08fee945a19e"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:07.671881 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:07.678267 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-f55a7b29-e0a6-4e1f-b683-5bddbeb55e0f req-31334a3f-f3ca-4058-a065-a02e10884c5d service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:07.678744 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-f55a7b29-e0a6-4e1f-b683-5bddbeb55e0f req-31334a3f-f3ca-4058-a065-a02e10884c5d service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:07.694351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-f55a7b29-e0a6-4e1f-b683-5bddbeb55e0f req-31334a3f-f3ca-4058-a065-a02e10884c5d service nova] Creating event network-vif-deleted:79a043b7-5f2a-464b-9615-08fee945a19e for instance 240252a3-813b-4e1c-bd56-efa9695c9f56 on hv-cinder-84254 May 27 15:22:07.702088 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-f55a7b29-e0a6-4e1f-b683-5bddbeb55e0f req-31334a3f-f3ca-4058-a065-a02e10884c5d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040796 May 27 15:22:07.702703 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 485/946] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:08.010897 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-14b8ec44-27bc-487a-a4ff-ef7e21293e32 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:08.011445 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-14b8ec44-27bc-487a-a4ff-ef7e21293e32 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] [instance: 240252a3-813b-4e1c-bd56-efa9695c9f56] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:08.017925 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-14b8ec44-27bc-487a-a4ff-ef7e21293e32 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:08.018380 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-14b8ec44-27bc-487a-a4ff-ef7e21293e32 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:08.019180 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-14b8ec44-27bc-487a-a4ff-ef7e21293e32 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:08.019624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-14b8ec44-27bc-487a-a4ff-ef7e21293e32 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:08.050703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-14b8ec44-27bc-487a-a4ff-ef7e21293e32 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:08.051188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-14b8ec44-27bc-487a-a4ff-ef7e21293e32 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:08.051640 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.objects.instance [None req-14b8ec44-27bc-487a-a4ff-ef7e21293e32 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lazy-loading 'fault' on Instance uuid 240252a3-813b-4e1c-bd56-efa9695c9f56 {{(pid=117743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:22:08.096327 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-14b8ec44-27bc-487a-a4ff-ef7e21293e32 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb25251cbd442a89f0a73bf35e76c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c3ebf345dbe46f7a137e1a62dee5f33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:08.104685 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-14b8ec44-27bc-487a-a4ff-ef7e21293e32 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] 10.222.0.50 "GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56" status: 200 len: 1305 microversion: 2.1 time: 0.097857 May 27 15:22:08.105258 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 462/947] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:08 2022] GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56 => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:09.123336 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-17449d4a-785a-4e23-8b47-2b6c2a44d0a4 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:09.124024 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-17449d4a-785a-4e23-8b47-2b6c2a44d0a4 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] [instance: 240252a3-813b-4e1c-bd56-efa9695c9f56] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:09.130510 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-17449d4a-785a-4e23-8b47-2b6c2a44d0a4 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:09.130979 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-17449d4a-785a-4e23-8b47-2b6c2a44d0a4 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:09.131740 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-17449d4a-785a-4e23-8b47-2b6c2a44d0a4 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:09.132178 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-17449d4a-785a-4e23-8b47-2b6c2a44d0a4 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:09.145145 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-17449d4a-785a-4e23-8b47-2b6c2a44d0a4 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] HTTP exception thrown: Instance 240252a3-813b-4e1c-bd56-efa9695c9f56 could not be found. May 27 15:22:09.146732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-17449d4a-785a-4e23-8b47-2b6c2a44d0a4 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Request method failure captured: May 27 15:22:09.146732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56 HTTP/1.1 May 27 15:22:09.146732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:22:09.146732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:22:09.146732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:22:09.146732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:22:09.146732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:22:09.146732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:22:09.146732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:22:09.146732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:22:09.146732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOyO6UVICRA0cCHYP89m31RuXJiZ--pEnHUHFXstIfh7mGnfmL1MQnIpJhTmWj5PV_JO5YYoaUtgwctcGMoiwiw2DU648A1LXnp41Yejn18L9kcqX0p1JLB-7GQHMUVxZDmd4m-2PwZWnQUhMcqE9VlnuuC8-iEHbicvYfeMw4xTMsk May 27 15:22:09.146732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:22:09.146732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:22:09.146732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:22:09.146732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:22:09.146732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:22:09.146732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:22:09.146732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: 9c3ebf345dbe46f7a137e1a62dee5f33 May 27 15:22:09.146732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-VolumesNegativeTest-1141660103 May 27 15:22:09.146732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:22:09.146732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:22:09.148495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9c3ebf345dbe46f7a137e1a62dee5f33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9c3ebf345dbe46f7a137e1a62dee5f33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9c3ebf345dbe46f7a137e1a62dee5f33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9c3ebf345dbe46f7a137e1a62dee5f33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:22:09.148495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-VolumesNegativeTest-1141660103 May 27 15:22:09.148495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: 9c3ebf345dbe46f7a137e1a62dee5f33 May 27 15:22:09.148495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-VolumesNegativeTest-1141660103 May 27 15:22:09.148495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-VolumesNegativeTest-1141660103-project May 27 15:22:09.148495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:22:09.148495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:22:09.148495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 4cb25251cbd442a89f0a73bf35e76c3c May 27 15:22:09.148495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-VolumesNegativeTest-1141660103-project May 27 15:22:09.148495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:22:09.148495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance 240252a3-813b-4e1c-bd56-efa9695c9f56 could not be found. May 27 15:22:09.148495 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': '240252a3-813b-4e1c-bd56-efa9695c9f56'} May 27 15:22:09.149368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:22:09.149368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:09.149368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:22:09.149368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:22:09.149368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:22:09.149368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:22:09.149368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:22:09.149368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:22:09.149368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:22:09.149368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:22:09.149368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 240252a3-813b-4e1c-bd56-efa9695c9f56 could not be found. May 27 15:22:09.149368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:22:09.149368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:09.149368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:22:09.149368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:09.149368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:09.149368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:09.149368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:22:09.149368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:22:09.149368 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:22:09.150920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:22:09.150920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:22:09.150920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:22:09.150920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:22:09.150920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:22:09.150920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:22:09.150920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:22:09.150920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 240252a3-813b-4e1c-bd56-efa9695c9f56 could not be found. May 27 15:22:09.150920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:22:09.150920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:09.150920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:22:09.150920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:09.150920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:09.150920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:09.150920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:22:09.150920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:22:09.150920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 240252a3-813b-4e1c-bd56-efa9695c9f56 could not be found. May 27 15:22:09.150920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:22:09.152076 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-17449d4a-785a-4e23-8b47-2b6c2a44d0a4 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] Returning 404 to user: Instance 240252a3-813b-4e1c-bd56-efa9695c9f56 could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:22:09.152076 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-17449d4a-785a-4e23-8b47-2b6c2a44d0a4 tempest-VolumesNegativeTest-1141660103 tempest-VolumesNegativeTest-1141660103-project] 10.222.0.50 "GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56" status: 404 len: 111 microversion: 2.1 time: 0.029498 May 27 15:22:09.152076 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 486/948] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:09 2022] GET /compute/v2.1/servers/240252a3-813b-4e1c-bd56-efa9695c9f56 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:22:37.524598 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-2787e9d7-2024-4898-ac66-26aa2938c961 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:37.525600 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-2787e9d7-2024-4898-ac66-26aa2938c961 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:37.528125 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:37.528766 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:37.534963 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2787e9d7-2024-4898-ac66-26aa2938c961 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:37.535416 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2787e9d7-2024-4898-ac66-26aa2938c961 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:37.536190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2787e9d7-2024-4898-ac66-26aa2938c961 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:37.536624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-2787e9d7-2024-4898-ac66-26aa2938c961 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:37.568714 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-2787e9d7-2024-4898-ac66-26aa2938c961 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048282 May 27 15:22:37.569284 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 463/949] 10.222.0.50 () {60 vars in 1342 bytes} [Fri May 27 15:22:37 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:37.629024 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-c1bb3808-a863-43a3-babc-523887aaed6f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:37.629590 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-c1bb3808-a863-43a3-babc-523887aaed6f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:37.632612 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=3 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:37.633337 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=90 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:37.639371 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c1bb3808-a863-43a3-babc-523887aaed6f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:37.639826 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c1bb3808-a863-43a3-babc-523887aaed6f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:37.640603 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c1bb3808-a863-43a3-babc-523887aaed6f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:37.641046 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c1bb3808-a863-43a3-babc-523887aaed6f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:37.667200 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-c1bb3808-a863-43a3-babc-523887aaed6f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Going to try to terminate instance {{(pid=117742) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:22:37.746096 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-c1bb3808-a863-43a3-babc-523887aaed6f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 204 len: 0 microversion: 2.20 time: 0.120970 May 27 15:22:37.746715 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 487/950] 10.222.0.50 () {60 vars in 1279 bytes} [Fri May 27 15:22:37 2022] DELETE /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:22:37.755363 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-366d9027-54d3-4c3e-89ca-4df2329ea45f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:37.756536 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-366d9027-54d3-4c3e-89ca-4df2329ea45f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:37.762626 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-366d9027-54d3-4c3e-89ca-4df2329ea45f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:37.763113 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-366d9027-54d3-4c3e-89ca-4df2329ea45f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:37.763885 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-366d9027-54d3-4c3e-89ca-4df2329ea45f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:37.764318 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-366d9027-54d3-4c3e-89ca-4df2329ea45f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:37.907413 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-366d9027-54d3-4c3e-89ca-4df2329ea45f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:37.915929 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-366d9027-54d3-4c3e-89ca-4df2329ea45f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:37.917445 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-366d9027-54d3-4c3e-89ca-4df2329ea45f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:37.918606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-366d9027-54d3-4c3e-89ca-4df2329ea45f tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1725 microversion: 2.20 time: 0.167185 May 27 15:22:37.919217 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 464/951] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:22:37 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:38.937985 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-253c2a9b-da78-40a8-84ae-cca15cea5ae2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:38.938680 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-253c2a9b-da78-40a8-84ae-cca15cea5ae2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:38.945854 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-253c2a9b-da78-40a8-84ae-cca15cea5ae2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:38.946306 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-253c2a9b-da78-40a8-84ae-cca15cea5ae2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:38.947109 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-253c2a9b-da78-40a8-84ae-cca15cea5ae2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:38.947550 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-253c2a9b-da78-40a8-84ae-cca15cea5ae2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:39.078377 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-253c2a9b-da78-40a8-84ae-cca15cea5ae2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:39.087108 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-253c2a9b-da78-40a8-84ae-cca15cea5ae2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:39.088599 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-253c2a9b-da78-40a8-84ae-cca15cea5ae2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:39.089762 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-253c2a9b-da78-40a8-84ae-cca15cea5ae2 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1725 microversion: 2.20 time: 0.156275 May 27 15:22:39.090321 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 488/952] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:22:38 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:40.108247 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-37503104-80a9-4d5f-b69d-b1e1a400933e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:40.108892 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-37503104-80a9-4d5f-b69d-b1e1a400933e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:40.115635 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-37503104-80a9-4d5f-b69d-b1e1a400933e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:40.116169 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-37503104-80a9-4d5f-b69d-b1e1a400933e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:40.116973 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-37503104-80a9-4d5f-b69d-b1e1a400933e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:40.117405 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-37503104-80a9-4d5f-b69d-b1e1a400933e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:40.189672 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-37503104-80a9-4d5f-b69d-b1e1a400933e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:40.198585 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-37503104-80a9-4d5f-b69d-b1e1a400933e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:40.200153 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-37503104-80a9-4d5f-b69d-b1e1a400933e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a990918de6d409a949616da90de6a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20b51981801495aacd31a56e87d0e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:40.201300 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-37503104-80a9-4d5f-b69d-b1e1a400933e tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 200 len: 1657 microversion: 2.20 time: 0.097171 May 27 15:22:40.201852 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 465/953] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:22:40 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 1657 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 15:22:40.438024 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-9350a0b9-b9fe-413e-b67a-b860d875536a req-8780ea3c-cc02-4048-a7f8-c43751b0413f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1c52039-f595-4f22-9df9-ea3a999f55fe", "name": "network-vif-deleted", "tag": "00ae88d7-8fbc-40d5-aefb-819837b95c30"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:40.446473 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-9350a0b9-b9fe-413e-b67a-b860d875536a req-8780ea3c-cc02-4048-a7f8-c43751b0413f service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:40.446953 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-9350a0b9-b9fe-413e-b67a-b860d875536a req-8780ea3c-cc02-4048-a7f8-c43751b0413f service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:40.457945 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-9350a0b9-b9fe-413e-b67a-b860d875536a req-8780ea3c-cc02-4048-a7f8-c43751b0413f service nova] Creating event network-vif-deleted:00ae88d7-8fbc-40d5-aefb-819837b95c30 for instance f1c52039-f595-4f22-9df9-ea3a999f55fe on hv-cinder-84254 May 27 15:22:40.463981 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-9350a0b9-b9fe-413e-b67a-b860d875536a req-8780ea3c-cc02-4048-a7f8-c43751b0413f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030875 May 27 15:22:40.464773 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 489/954] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:41.220452 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-4fb28690-bb8d-457d-9eba-b51c4d99e1e5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:41.221086 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-4fb28690-bb8d-457d-9eba-b51c4d99e1e5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:41.228021 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4fb28690-bb8d-457d-9eba-b51c4d99e1e5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:41.228471 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4fb28690-bb8d-457d-9eba-b51c4d99e1e5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:41.229240 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4fb28690-bb8d-457d-9eba-b51c4d99e1e5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:41.229680 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4fb28690-bb8d-457d-9eba-b51c4d99e1e5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:41.243938 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-4fb28690-bb8d-457d-9eba-b51c4d99e1e5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] HTTP exception thrown: Instance f1c52039-f595-4f22-9df9-ea3a999f55fe could not be found. May 27 15:22:41.245619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-4fb28690-bb8d-457d-9eba-b51c4d99e1e5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Request method failure captured: May 27 15:22:41.245619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe HTTP/1.1 May 27 15:22:41.245619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:22:41.245619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:22:41.245619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:22:41.245619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 0 May 27 15:22:41.245619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:22:41.245619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:22:41.245619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:22:41.245619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:22:41.245619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOryEvQW80jWw1BZQMtbEkYLzK31YlVi3G6VuQOJnB0o-s9mBgStL9hmb9atC4oxGVdIybXz1gW4wa77rCeQAOi_6xwCsR2sej6oCIC1cnK4jyw8gKmGRMxNtBlLOvmE0u3MTICzL7-TNerkVLiaGqwQVyVoHc8mq4nwttC2Ay0qkTI May 27 15:22:41.245619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:22:41.245619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:22:41.245619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:22:41.245619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:22:41.245619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Openstack-Nova-Api-Version: 2.20 May 27 15:22:41.245619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:22:41.245619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:22:41.245619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: f20b51981801495aacd31a56e87d0e3c May 27 15:22:41.245619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-516093280 May 27 15:22:41.245619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:22:41.245619 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:22:41.247436 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:22:41.247436 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-AttachVolumeShelveTestJSON-516093280 May 27 15:22:41.247436 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: f20b51981801495aacd31a56e87d0e3c May 27 15:22:41.247436 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-516093280 May 27 15:22:41.247436 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-AttachVolumeShelveTestJSON-516093280-project May 27 15:22:41.247436 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:22:41.247436 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:22:41.247436 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: 5a990918de6d409a949616da90de6a5e May 27 15:22:41.247436 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-AttachVolumeShelveTestJSON-516093280-project May 27 15:22:41.247436 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: > May 27 15:22:41.247436 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Instance f1c52039-f595-4f22-9df9-ea3a999f55fe could not be found. May 27 15:22:41.247436 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'id': 'f1c52039-f595-4f22-9df9-ea3a999f55fe'} May 27 15:22:41.248606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:22:41.248606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:41.248606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:22:41.248606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:22:41.248606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:22:41.248606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:22:41.248606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:22:41.248606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:22:41.248606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:22:41.248606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:22:41.248606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1c52039-f595-4f22-9df9-ea3a999f55fe could not be found. May 27 15:22:41.248606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:22:41.248606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:41.248606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:22:41.248606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:41.248606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:41.248606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:41.248606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:22:41.248606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:22:41.248606 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:22:41.251425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:22:41.251425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:22:41.251425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:22:41.251425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:22:41.251425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:22:41.251425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:22:41.251425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:22:41.251425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1c52039-f595-4f22-9df9-ea3a999f55fe could not be found. May 27 15:22:41.251425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:22:41.251425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:41.251425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:22:41.251425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:41.251425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:41.251425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:41.251425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:22:41.251425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:22:41.251425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1c52039-f595-4f22-9df9-ea3a999f55fe could not be found. May 27 15:22:41.251425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:22:41.253874 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-4fb28690-bb8d-457d-9eba-b51c4d99e1e5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Returning 404 to user: Instance f1c52039-f595-4f22-9df9-ea3a999f55fe could not be found. {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:22:41.253874 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-4fb28690-bb8d-457d-9eba-b51c4d99e1e5 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 404 len: 111 microversion: 2.20 time: 0.030705 May 27 15:22:41.253874 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 466/955] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:22:41 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:22:41.257724 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-9ac0aa64-30d5-440c-9d67-cfa5a2af98a7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '.version_select at 0x7f57e195c040>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:41.276969 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-9ac0aa64-30d5-440c-9d67-cfa5a2af98a7 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777242968" status: 204 len: 0 microversion: 2.20 time: 0.024364 May 27 15:22:41.277558 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 490/956] 10.222.0.50 () {60 vars in 1261 bytes} [Fri May 27 15:22:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777242968 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 15:22:42.104690 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-55f7e167-bd06-4556-8e17-8131ab59651a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-564378700", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-504926628", "security_groups": [{"name": "tempest-secgroup-smoke-1034671319"}], "block_device_mapping_v2": [{"uuid": "f090736c-4e32-4193-9201-adca85368c70", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2342e702-bd4d-4c84-b0ae-7b5944b1b9c3"}]}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:42.230712 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.network.neutron [None req-55f7e167-bd06-4556-8e17-8131ab59651a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] validate_networks() for [('2342e702-bd4d-4c84-b0ae-7b5944b1b9c3', None, None, None, None, None)] {{(pid=117743) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:22:42.608128 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-55f7e167-bd06-4556-8e17-8131ab59651a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Flavor limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:22:42.608555 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-55f7e167-bd06-4556-8e17-8131ab59651a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Image limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:22:42.609026 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-55f7e167-bd06-4556-8e17-8131ab59651a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Flavor pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:22:42.609469 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-55f7e167-bd06-4556-8e17-8131ab59651a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Image pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:22:42.609878 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-55f7e167-bd06-4556-8e17-8131ab59651a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:22:42.619590 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-55f7e167-bd06-4556-8e17-8131ab59651a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:42.620033 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-55f7e167-bd06-4556-8e17-8131ab59651a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:42.620857 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-55f7e167-bd06-4556-8e17-8131ab59651a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:42.621290 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-55f7e167-bd06-4556-8e17-8131ab59651a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:42.637931 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-55f7e167-bd06-4556-8e17-8131ab59651a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Getting quotas for project f88bb4c8b75c4ad6be62f2cf5cf509c4. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:22:42.641842 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-55f7e167-bd06-4556-8e17-8131ab59651a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Getting quotas for user af74115f423c43fdb2544876be4e5622 and project f88bb4c8b75c4ad6be62f2cf5cf509c4. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:22:42.698733 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-55f7e167-bd06-4556-8e17-8131ab59651a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Going to run 1 instances... {{(pid=117743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:22:42.700842 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-55f7e167-bd06-4556-8e17-8131ab59651a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 1c7e1edd-4f64-464a-b285-ff67845f9fbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f090736c-4e32-4193-9201-adca85368c70',volume_size=None,volume_type=None)] {{(pid=117743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:22:42.825700 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-55f7e167-bd06-4556-8e17-8131ab59651a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.724933 May 27 15:22:42.826386 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 467/957] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 15:22:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:22:42.836850 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-80c5f191-6b09-46fe-a083-c64a3c7ac6f6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:42.837586 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-80c5f191-6b09-46fe-a083-c64a3c7ac6f6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 1c7e1edd-4f64-464a-b285-ff67845f9fbd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:42.893177 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-80c5f191-6b09-46fe-a083-c64a3c7ac6f6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:42.901180 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-80c5f191-6b09-46fe-a083-c64a3c7ac6f6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd" status: 200 len: 1093 microversion: 2.1 time: 0.068676 May 27 15:22:42.901749 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 491/958] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:42 2022] GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:43.104600 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-786b7caf-13af-48b0-aadc-85b5e91b4c75 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:43.105094 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-786b7caf-13af-48b0-aadc-85b5e91b4c75 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:43.112014 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-786b7caf-13af-48b0-aadc-85b5e91b4c75 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:43.112583 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-786b7caf-13af-48b0-aadc-85b5e91b4c75 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:43.113374 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-786b7caf-13af-48b0-aadc-85b5e91b4c75 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:43.113820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-786b7caf-13af-48b0-aadc-85b5e91b4c75 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:43.127317 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-786b7caf-13af-48b0-aadc-85b5e91b4c75 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] HTTP exception thrown: Instance f1c52039-f595-4f22-9df9-ea3a999f55fe could not be found. May 27 15:22:43.128936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-786b7caf-13af-48b0-aadc-85b5e91b4c75 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Request method failure captured: May 27 15:22:43.128936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: DELETE /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe HTTP/1.1 May 27 15:22:43.128936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:22:43.128936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:22:43.128936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:22:43.128936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 0 May 27 15:22:43.128936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:22:43.128936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:22:43.128936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:22:43.128936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:22:43.128936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOryEvQW80jWw1BZQMtbEkYLzK31YlVi3G6VuQOJnB0o-s9mBgStL9hmb9atC4oxGVdIybXz1gW4wa77rCeQAOi_6xwCsR2sej6oCIC1cnK4jyw8gKmGRMxNtBlLOvmE0u3MTICzL7-TNerkVLiaGqwQVyVoHc8mq4nwttC2Ay0qkTI May 27 15:22:43.128936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:22:43.128936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:22:43.128936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:22:43.128936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:22:43.128936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Openstack-Nova-Api-Version: 2.20 May 27 15:22:43.128936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:22:43.128936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:22:43.128936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: f20b51981801495aacd31a56e87d0e3c May 27 15:22:43.128936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-516093280 May 27 15:22:43.128936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:22:43.128936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:22:43.130600 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:22:43.130600 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-AttachVolumeShelveTestJSON-516093280 May 27 15:22:43.130600 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: f20b51981801495aacd31a56e87d0e3c May 27 15:22:43.130600 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-516093280 May 27 15:22:43.130600 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-AttachVolumeShelveTestJSON-516093280-project May 27 15:22:43.130600 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:22:43.130600 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:22:43.130600 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: 5a990918de6d409a949616da90de6a5e May 27 15:22:43.130600 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-AttachVolumeShelveTestJSON-516093280-project May 27 15:22:43.130600 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: > May 27 15:22:43.130600 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Instance f1c52039-f595-4f22-9df9-ea3a999f55fe could not be found. May 27 15:22:43.130600 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'id': 'f1c52039-f595-4f22-9df9-ea3a999f55fe'} May 27 15:22:43.131982 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:22:43.131982 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:43.131982 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:22:43.131982 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:22:43.131982 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:22:43.131982 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:22:43.131982 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:22:43.131982 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:22:43.131982 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:22:43.131982 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:22:43.131982 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1c52039-f595-4f22-9df9-ea3a999f55fe could not be found. May 27 15:22:43.131982 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:22:43.131982 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:43.131982 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:22:43.131982 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:43.131982 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:43.131982 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:43.131982 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:22:43.131982 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:22:43.131982 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:22:43.133728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:22:43.133728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:22:43.133728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:22:43.133728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:22:43.133728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:22:43.133728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:22:43.133728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:22:43.133728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:22:43.133728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:22:43.133728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1c52039-f595-4f22-9df9-ea3a999f55fe could not be found. May 27 15:22:43.133728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:22:43.133728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:43.133728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:22:43.133728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:43.133728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:43.133728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:43.133728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:22:43.133728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:22:43.133728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1c52039-f595-4f22-9df9-ea3a999f55fe could not be found. May 27 15:22:43.133728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:22:43.135204 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-786b7caf-13af-48b0-aadc-85b5e91b4c75 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Returning 404 to user: Instance f1c52039-f595-4f22-9df9-ea3a999f55fe could not be found. {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:22:43.135204 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-786b7caf-13af-48b0-aadc-85b5e91b4c75 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 404 len: 111 microversion: 2.20 time: 0.029653 May 27 15:22:43.135204 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 468/959] 10.222.0.50 () {60 vars in 1279 bytes} [Fri May 27 15:22:43 2022] DELETE /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:22:43.139829 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-7b94a269-37a8-4573-9526-0c210676d988 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:43.140390 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-7b94a269-37a8-4573-9526-0c210676d988 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: f1c52039-f595-4f22-9df9-ea3a999f55fe] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:43.147415 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7b94a269-37a8-4573-9526-0c210676d988 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:43.147871 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7b94a269-37a8-4573-9526-0c210676d988 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:43.148638 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7b94a269-37a8-4573-9526-0c210676d988 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:43.149234 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7b94a269-37a8-4573-9526-0c210676d988 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:43.164595 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-7b94a269-37a8-4573-9526-0c210676d988 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] HTTP exception thrown: Instance f1c52039-f595-4f22-9df9-ea3a999f55fe could not be found. May 27 15:22:43.166318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-7b94a269-37a8-4573-9526-0c210676d988 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Request method failure captured: May 27 15:22:43.166318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe HTTP/1.1 May 27 15:22:43.166318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:22:43.166318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:22:43.166318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:22:43.166318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:22:43.166318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:22:43.166318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:22:43.166318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:22:43.166318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:22:43.166318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOryEvQW80jWw1BZQMtbEkYLzK31YlVi3G6VuQOJnB0o-s9mBgStL9hmb9atC4oxGVdIybXz1gW4wa77rCeQAOi_6xwCsR2sej6oCIC1cnK4jyw8gKmGRMxNtBlLOvmE0u3MTICzL7-TNerkVLiaGqwQVyVoHc8mq4nwttC2Ay0qkTI May 27 15:22:43.166318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:22:43.166318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:22:43.166318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:22:43.166318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:22:43.166318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Openstack-Nova-Api-Version: 2.20 May 27 15:22:43.166318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:22:43.166318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:22:43.166318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: f20b51981801495aacd31a56e87d0e3c May 27 15:22:43.166318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-516093280 May 27 15:22:43.166318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:22:43.166318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:22:43.168024 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:22:43.168024 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-AttachVolumeShelveTestJSON-516093280 May 27 15:22:43.168024 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: f20b51981801495aacd31a56e87d0e3c May 27 15:22:43.168024 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-516093280 May 27 15:22:43.168024 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-AttachVolumeShelveTestJSON-516093280-project May 27 15:22:43.168024 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:22:43.168024 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:22:43.168024 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 5a990918de6d409a949616da90de6a5e May 27 15:22:43.168024 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-AttachVolumeShelveTestJSON-516093280-project May 27 15:22:43.168024 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:22:43.168024 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance f1c52039-f595-4f22-9df9-ea3a999f55fe could not be found. May 27 15:22:43.168024 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': 'f1c52039-f595-4f22-9df9-ea3a999f55fe'} May 27 15:22:43.168870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:22:43.168870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:43.168870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:22:43.168870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:22:43.168870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:22:43.168870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:22:43.168870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:22:43.168870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:22:43.168870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:22:43.168870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:22:43.168870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1c52039-f595-4f22-9df9-ea3a999f55fe could not be found. May 27 15:22:43.168870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:22:43.168870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:43.168870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:22:43.168870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:43.168870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:43.168870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:43.168870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:22:43.168870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:22:43.168870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:22:43.170326 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:22:43.170326 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:22:43.170326 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:22:43.170326 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:22:43.170326 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:22:43.170326 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:22:43.170326 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:22:43.170326 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1c52039-f595-4f22-9df9-ea3a999f55fe could not be found. May 27 15:22:43.170326 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:22:43.170326 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:43.170326 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:22:43.170326 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:43.170326 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:43.170326 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:43.170326 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:22:43.170326 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:22:43.170326 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1c52039-f595-4f22-9df9-ea3a999f55fe could not be found. May 27 15:22:43.170326 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:22:43.172039 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-7b94a269-37a8-4573-9526-0c210676d988 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Returning 404 to user: Instance f1c52039-f595-4f22-9df9-ea3a999f55fe could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:22:43.172039 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-7b94a269-37a8-4573-9526-0c210676d988 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe" status: 404 len: 111 microversion: 2.20 time: 0.032128 May 27 15:22:43.172039 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 492/960] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:22:43 2022] GET /compute/v2.1/servers/f1c52039-f595-4f22-9df9-ea3a999f55fe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 27 15:22:43.918284 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a125a110-c96c-4ea0-a277-bf8721f3479c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:43.919164 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a125a110-c96c-4ea0-a277-bf8721f3479c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 1c7e1edd-4f64-464a-b285-ff67845f9fbd] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:43.926462 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a125a110-c96c-4ea0-a277-bf8721f3479c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:43.927341 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a125a110-c96c-4ea0-a277-bf8721f3479c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:43.929144 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a125a110-c96c-4ea0-a277-bf8721f3479c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:43.929662 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a125a110-c96c-4ea0-a277-bf8721f3479c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:43.995296 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a125a110-c96c-4ea0-a277-bf8721f3479c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:44.003037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a125a110-c96c-4ea0-a277-bf8721f3479c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd" status: 200 len: 1199 microversion: 2.1 time: 0.088545 May 27 15:22:44.003610 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 469/961] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:43 2022] GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd => generated 1199 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:44.484959 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-717089aa-7f88-4577-912e-ba3c3d67fa27 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:44.485509 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-717089aa-7f88-4577-912e-ba3c3d67fa27 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:44.492229 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-717089aa-7f88-4577-912e-ba3c3d67fa27 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:44.492675 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-717089aa-7f88-4577-912e-ba3c3d67fa27 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:44.493443 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-717089aa-7f88-4577-912e-ba3c3d67fa27 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:44.493876 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-717089aa-7f88-4577-912e-ba3c3d67fa27 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:44.507708 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-717089aa-7f88-4577-912e-ba3c3d67fa27 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] HTTP exception thrown: Instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed could not be found. May 27 15:22:44.509419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-717089aa-7f88-4577-912e-ba3c3d67fa27 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Request method failure captured: May 27 15:22:44.509419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: DELETE /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed HTTP/1.1 May 27 15:22:44.509419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:22:44.509419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:22:44.509419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:22:44.509419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:22:44.509419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:22:44.509419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:22:44.509419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:22:44.509419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:22:44.509419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOryEvQW80jWw1BZQMtbEkYLzK31YlVi3G6VuQOJnB0o-s9mBgStL9hmb9atC4oxGVdIybXz1gW4wa77rCeQAOi_6xwCsR2sej6oCIC1cnK4jyw8gKmGRMxNtBlLOvmE0u3MTICzL7-TNerkVLiaGqwQVyVoHc8mq4nwttC2Ay0qkTI May 27 15:22:44.509419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:22:44.509419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:22:44.509419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:22:44.509419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:22:44.509419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Openstack-Nova-Api-Version: 2.20 May 27 15:22:44.509419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:22:44.509419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:22:44.509419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: f20b51981801495aacd31a56e87d0e3c May 27 15:22:44.509419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-516093280 May 27 15:22:44.509419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:22:44.509419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:22:44.511124 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:22:44.511124 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-AttachVolumeShelveTestJSON-516093280 May 27 15:22:44.511124 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: f20b51981801495aacd31a56e87d0e3c May 27 15:22:44.511124 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-516093280 May 27 15:22:44.511124 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-AttachVolumeShelveTestJSON-516093280-project May 27 15:22:44.511124 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:22:44.511124 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:22:44.511124 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: 5a990918de6d409a949616da90de6a5e May 27 15:22:44.511124 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-AttachVolumeShelveTestJSON-516093280-project May 27 15:22:44.511124 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:22:44.511124 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed could not be found. May 27 15:22:44.511124 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': 'b88bbd4b-d173-4df5-9e19-4fedb81b4aed'} May 27 15:22:44.512006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:22:44.512006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:44.512006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:22:44.512006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:22:44.512006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:22:44.512006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:22:44.512006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:22:44.512006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:22:44.512006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:22:44.512006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:22:44.512006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed could not be found. May 27 15:22:44.512006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:22:44.512006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:44.512006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:22:44.512006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:44.512006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:44.512006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:44.512006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:22:44.512006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:22:44.512006 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:22:44.513451 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:22:44.513451 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:22:44.513451 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:22:44.513451 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:22:44.513451 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:22:44.513451 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:22:44.513451 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:22:44.513451 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:22:44.513451 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:22:44.513451 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed could not be found. May 27 15:22:44.513451 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:22:44.513451 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:44.513451 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:22:44.513451 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:44.513451 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:44.513451 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:44.513451 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:22:44.513451 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:22:44.513451 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed could not be found. May 27 15:22:44.513451 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:22:44.514945 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-717089aa-7f88-4577-912e-ba3c3d67fa27 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Returning 404 to user: Instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:22:44.514945 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-717089aa-7f88-4577-912e-ba3c3d67fa27 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 404 len: 111 microversion: 2.20 time: 0.029727 May 27 15:22:44.514945 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 493/962] 10.222.0.50 () {60 vars in 1279 bytes} [Fri May 27 15:22:44 2022] DELETE /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:22:44.519686 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f08b64e6-c525-4515-aab7-d45dd9b44727 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:44.520296 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-f08b64e6-c525-4515-aab7-d45dd9b44727 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] [instance: b88bbd4b-d173-4df5-9e19-4fedb81b4aed] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:44.527275 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f08b64e6-c525-4515-aab7-d45dd9b44727 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:44.527730 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f08b64e6-c525-4515-aab7-d45dd9b44727 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:44.528514 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f08b64e6-c525-4515-aab7-d45dd9b44727 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:44.528965 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f08b64e6-c525-4515-aab7-d45dd9b44727 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:44.547061 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-f08b64e6-c525-4515-aab7-d45dd9b44727 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] HTTP exception thrown: Instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed could not be found. May 27 15:22:44.549391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f08b64e6-c525-4515-aab7-d45dd9b44727 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Request method failure captured: May 27 15:22:44.549391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed HTTP/1.1 May 27 15:22:44.549391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:22:44.549391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:22:44.549391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:22:44.549391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 0 May 27 15:22:44.549391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:22:44.549391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:22:44.549391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:22:44.549391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:22:44.549391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOryEvQW80jWw1BZQMtbEkYLzK31YlVi3G6VuQOJnB0o-s9mBgStL9hmb9atC4oxGVdIybXz1gW4wa77rCeQAOi_6xwCsR2sej6oCIC1cnK4jyw8gKmGRMxNtBlLOvmE0u3MTICzL7-TNerkVLiaGqwQVyVoHc8mq4nwttC2Ay0qkTI May 27 15:22:44.549391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:22:44.549391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:22:44.549391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:22:44.549391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:22:44.549391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Openstack-Nova-Api-Version: 2.20 May 27 15:22:44.549391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:22:44.549391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:22:44.549391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: f20b51981801495aacd31a56e87d0e3c May 27 15:22:44.549391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-516093280 May 27 15:22:44.549391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:22:44.549391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:22:44.550891 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f20b51981801495aacd31a56e87d0e3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:22:44.550891 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-AttachVolumeShelveTestJSON-516093280 May 27 15:22:44.550891 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: f20b51981801495aacd31a56e87d0e3c May 27 15:22:44.550891 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-516093280 May 27 15:22:44.550891 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-AttachVolumeShelveTestJSON-516093280-project May 27 15:22:44.550891 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:22:44.550891 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:22:44.550891 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: 5a990918de6d409a949616da90de6a5e May 27 15:22:44.550891 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-AttachVolumeShelveTestJSON-516093280-project May 27 15:22:44.550891 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: > May 27 15:22:44.550891 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed could not be found. May 27 15:22:44.550891 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'id': 'b88bbd4b-d173-4df5-9e19-4fedb81b4aed'} May 27 15:22:44.555824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:22:44.555824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:44.555824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:22:44.555824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:22:44.555824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:22:44.555824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:22:44.555824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:22:44.555824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:22:44.555824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:22:44.555824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:22:44.555824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed could not be found. May 27 15:22:44.555824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:22:44.555824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:44.555824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:22:44.555824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:44.555824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:44.555824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:44.555824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:22:44.555824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:22:44.555824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:22:44.557050 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:22:44.557050 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:22:44.557050 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:22:44.557050 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:22:44.557050 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:22:44.557050 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:22:44.557050 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:22:44.557050 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed could not be found. May 27 15:22:44.557050 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:22:44.557050 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:22:44.557050 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:22:44.557050 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:22:44.557050 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:22:44.557050 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:22:44.557050 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:22:44.557050 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:22:44.557050 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed could not be found. May 27 15:22:44.557050 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:22:44.560298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f08b64e6-c525-4515-aab7-d45dd9b44727 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] Returning 404 to user: Instance b88bbd4b-d173-4df5-9e19-4fedb81b4aed could not be found. {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:22:44.560298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-f08b64e6-c525-4515-aab7-d45dd9b44727 tempest-AttachVolumeShelveTestJSON-516093280 tempest-AttachVolumeShelveTestJSON-516093280-project] 10.222.0.50 "GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed" status: 404 len: 111 microversion: 2.20 time: 0.035190 May 27 15:22:44.560298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 470/963] 10.222.0.50 () {60 vars in 1276 bytes} [Fri May 27 15:22:44 2022] GET /compute/v2.1/servers/b88bbd4b-d173-4df5-9e19-4fedb81b4aed => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 15:22:45.020506 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-19bbe9c9-7ac8-41bb-9f2a-0259715cae7f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:45.021112 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-19bbe9c9-7ac8-41bb-9f2a-0259715cae7f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 1c7e1edd-4f64-464a-b285-ff67845f9fbd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:45.029226 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-19bbe9c9-7ac8-41bb-9f2a-0259715cae7f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:45.029658 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-19bbe9c9-7ac8-41bb-9f2a-0259715cae7f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:45.030423 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-19bbe9c9-7ac8-41bb-9f2a-0259715cae7f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:45.030875 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-19bbe9c9-7ac8-41bb-9f2a-0259715cae7f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:45.268924 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-19bbe9c9-7ac8-41bb-9f2a-0259715cae7f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:45.278699 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-19bbe9c9-7ac8-41bb-9f2a-0259715cae7f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd" status: 200 len: 1265 microversion: 2.1 time: 0.262029 May 27 15:22:45.279320 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 494/964] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:45 2022] GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:45.389032 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-b18eac4a-3b21-45c9-bc5c-79348c0d7d8b req-cc481fd8-dde5-4cba-8484-b8a42b330cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c7e1edd-4f64-464a-b285-ff67845f9fbd", "tag": "9ba4f6ac-1735-4343-8ad5-506b1f2de62d"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:45.399975 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-b18eac4a-3b21-45c9-bc5c-79348c0d7d8b req-cc481fd8-dde5-4cba-8484-b8a42b330cf9 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:45.405241 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-b18eac4a-3b21-45c9-bc5c-79348c0d7d8b req-cc481fd8-dde5-4cba-8484-b8a42b330cf9 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:45.428241 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-b18eac4a-3b21-45c9-bc5c-79348c0d7d8b req-cc481fd8-dde5-4cba-8484-b8a42b330cf9 service nova] Creating event network-changed:9ba4f6ac-1735-4343-8ad5-506b1f2de62d for instance 1c7e1edd-4f64-464a-b285-ff67845f9fbd on hv-cinder-84254 May 27 15:22:45.433468 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-b18eac4a-3b21-45c9-bc5c-79348c0d7d8b req-cc481fd8-dde5-4cba-8484-b8a42b330cf9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047902 May 27 15:22:45.435002 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 471/965] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:46.297271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f217db48-fcc2-461a-9457-a60fac7cf175 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:46.298034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f217db48-fcc2-461a-9457-a60fac7cf175 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 1c7e1edd-4f64-464a-b285-ff67845f9fbd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:46.305320 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f217db48-fcc2-461a-9457-a60fac7cf175 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:46.305761 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f217db48-fcc2-461a-9457-a60fac7cf175 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:46.307098 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f217db48-fcc2-461a-9457-a60fac7cf175 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:46.307525 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f217db48-fcc2-461a-9457-a60fac7cf175 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:46.536123 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-f217db48-fcc2-461a-9457-a60fac7cf175 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:46.544887 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f217db48-fcc2-461a-9457-a60fac7cf175 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd" status: 200 len: 1265 microversion: 2.1 time: 0.251885 May 27 15:22:46.545467 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 495/966] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:46 2022] GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:47.562579 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d91b4d54-ba65-40f4-866c-649e5d50b821 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:47.563306 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-d91b4d54-ba65-40f4-866c-649e5d50b821 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 1c7e1edd-4f64-464a-b285-ff67845f9fbd] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:47.570151 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d91b4d54-ba65-40f4-866c-649e5d50b821 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:47.570600 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d91b4d54-ba65-40f4-866c-649e5d50b821 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:47.571398 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d91b4d54-ba65-40f4-866c-649e5d50b821 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:47.571828 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d91b4d54-ba65-40f4-866c-649e5d50b821 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:47.716095 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-d91b4d54-ba65-40f4-866c-649e5d50b821 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:47.724237 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-d91b4d54-ba65-40f4-866c-649e5d50b821 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd" status: 200 len: 1265 microversion: 2.1 time: 0.166400 May 27 15:22:47.724870 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 472/967] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:47 2022] GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:48.741710 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e34d026b-f565-4c4b-aea7-88c1399c544a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:48.742312 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e34d026b-f565-4c4b-aea7-88c1399c544a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 1c7e1edd-4f64-464a-b285-ff67845f9fbd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:48.748661 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e34d026b-f565-4c4b-aea7-88c1399c544a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:48.749098 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e34d026b-f565-4c4b-aea7-88c1399c544a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:48.750042 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e34d026b-f565-4c4b-aea7-88c1399c544a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:48.750471 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e34d026b-f565-4c4b-aea7-88c1399c544a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:48.906783 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-e34d026b-f565-4c4b-aea7-88c1399c544a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:48.915844 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-e34d026b-f565-4c4b-aea7-88c1399c544a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd" status: 200 len: 1265 microversion: 2.1 time: 0.178068 May 27 15:22:48.916797 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 496/968] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:48 2022] GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:49.940348 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-aacd71f5-22ee-4c60-9bbb-0bb57d2dd92c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:49.940965 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-aacd71f5-22ee-4c60-9bbb-0bb57d2dd92c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 1c7e1edd-4f64-464a-b285-ff67845f9fbd] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:49.949655 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-aacd71f5-22ee-4c60-9bbb-0bb57d2dd92c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:49.950111 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-aacd71f5-22ee-4c60-9bbb-0bb57d2dd92c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:49.950984 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-aacd71f5-22ee-4c60-9bbb-0bb57d2dd92c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:49.951429 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-aacd71f5-22ee-4c60-9bbb-0bb57d2dd92c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:50.101212 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-aacd71f5-22ee-4c60-9bbb-0bb57d2dd92c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:50.110598 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-aacd71f5-22ee-4c60-9bbb-0bb57d2dd92c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd" status: 200 len: 1265 microversion: 2.1 time: 0.174004 May 27 15:22:50.116019 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 473/969] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:49 2022] GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:51.131503 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-2f973cec-43a5-4a67-ab03-748356320e59 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:51.132592 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-2f973cec-43a5-4a67-ab03-748356320e59 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 1c7e1edd-4f64-464a-b285-ff67845f9fbd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:51.147626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2f973cec-43a5-4a67-ab03-748356320e59 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:51.149271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2f973cec-43a5-4a67-ab03-748356320e59 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:51.150386 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2f973cec-43a5-4a67-ab03-748356320e59 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:51.151007 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2f973cec-43a5-4a67-ab03-748356320e59 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:51.318646 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-2f973cec-43a5-4a67-ab03-748356320e59 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:51.327405 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-2f973cec-43a5-4a67-ab03-748356320e59 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd" status: 200 len: 1265 microversion: 2.1 time: 0.201587 May 27 15:22:51.327996 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 497/970] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:51 2022] GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:52.347813 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f6502d93-1d5d-422e-922c-b96eadf29350 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:52.348858 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-f6502d93-1d5d-422e-922c-b96eadf29350 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 1c7e1edd-4f64-464a-b285-ff67845f9fbd] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:52.366501 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f6502d93-1d5d-422e-922c-b96eadf29350 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:52.367254 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f6502d93-1d5d-422e-922c-b96eadf29350 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:52.368245 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f6502d93-1d5d-422e-922c-b96eadf29350 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:52.369608 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f6502d93-1d5d-422e-922c-b96eadf29350 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:52.614163 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f6502d93-1d5d-422e-922c-b96eadf29350 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:52.626237 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-f6502d93-1d5d-422e-922c-b96eadf29350 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd" status: 200 len: 1265 microversion: 2.1 time: 0.284398 May 27 15:22:52.628269 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 474/971] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:52 2022] GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd => generated 1265 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:53.645282 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-23e84e08-59d1-4a78-8c8f-ca9312e8df6f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:53.646059 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-23e84e08-59d1-4a78-8c8f-ca9312e8df6f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 1c7e1edd-4f64-464a-b285-ff67845f9fbd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:53.656854 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=2 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:53.660083 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-23e84e08-59d1-4a78-8c8f-ca9312e8df6f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:53.660724 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-23e84e08-59d1-4a78-8c8f-ca9312e8df6f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:53.661547 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-23e84e08-59d1-4a78-8c8f-ca9312e8df6f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:53.663052 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-23e84e08-59d1-4a78-8c8f-ca9312e8df6f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:53.796434 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=2 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:53.799365 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=6 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:22:53.842337 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-23e84e08-59d1-4a78-8c8f-ca9312e8df6f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:53.851563 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-23e84e08-59d1-4a78-8c8f-ca9312e8df6f tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd" status: 200 len: 1265 microversion: 2.1 time: 0.210373 May 27 15:22:53.852147 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 498/972] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:53 2022] GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:53.938130 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-29c0d12b-1b56-4d7b-8c99-034c52797637 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Action: 'create', calling method: .version_select at 0x7f57e218e0d0>, body: {"keypair": {"name": "tempest-keypair-1356387303", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuKLcGWsxFaWzwzHHd8ggiV/0gzPWcuoQqY+Vh6G7TzhSD5LjnZPTHUq8CEzRUcLYMGEnkNnEkTA/2eHwj/+AGJrphRbwdOLreZqYGiwhC0WmWehWKRoZ2+YPKpaOYijw=="}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:53.953908 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-29c0d12b-1b56-4d7b-8c99-034c52797637 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Getting quotas for project f027c3b75bc6430abd765a26269f9058. Resources: {'key_pairs'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:22:53.958082 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-29c0d12b-1b56-4d7b-8c99-034c52797637 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Getting quotas for user b1302d3b8649407ca010f12aad7a6597 and project f027c3b75bc6430abd765a26269f9058. Resources: {'key_pairs'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:22:53.986495 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-29c0d12b-1b56-4d7b-8c99-034c52797637 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.194745 May 27 15:22:53.988061 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 475/973] 10.222.0.50 () {60 vars in 1158 bytes} [Fri May 27 15:22:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:54.869130 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-5e7a0203-a8c4-4c15-8bcf-803b122c9aa6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:54.869899 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-5e7a0203-a8c4-4c15-8bcf-803b122c9aa6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 1c7e1edd-4f64-464a-b285-ff67845f9fbd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:54.876877 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5e7a0203-a8c4-4c15-8bcf-803b122c9aa6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:54.877613 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5e7a0203-a8c4-4c15-8bcf-803b122c9aa6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:54.878607 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5e7a0203-a8c4-4c15-8bcf-803b122c9aa6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:54.879299 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5e7a0203-a8c4-4c15-8bcf-803b122c9aa6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:55.109675 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5e7a0203-a8c4-4c15-8bcf-803b122c9aa6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:55.123108 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-5e7a0203-a8c4-4c15-8bcf-803b122c9aa6 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd" status: 200 len: 1265 microversion: 2.1 time: 0.257994 May 27 15:22:55.131239 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 499/974] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:54 2022] GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:55.687562 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-34397712-e381-4337-aa15-f2584291e1ef tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1195329090", "imageRef": "a9407644-1f68-43e6-beb1-ce2085766180", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b7857e3-255b-417e-82ed-fcdb2806f57d"}], "security_groups": [{"name": "tempest-securitygroup--789041299"}], "key_name": "tempest-keypair-1356387303", "user_data": "}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:55.800331 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.network.neutron [None req-34397712-e381-4337-aa15-f2584291e1ef tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] validate_networks() for [('6b7857e3-255b-417e-82ed-fcdb2806f57d', None, None, None, None, None)] {{(pid=117743) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:22:56.144701 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-6dfa70e8-0533-4512-be62-62be9dbd5ad3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:56.145321 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-6dfa70e8-0533-4512-be62-62be9dbd5ad3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 1c7e1edd-4f64-464a-b285-ff67845f9fbd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:56.156698 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6dfa70e8-0533-4512-be62-62be9dbd5ad3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:56.157324 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6dfa70e8-0533-4512-be62-62be9dbd5ad3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:56.158288 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6dfa70e8-0533-4512-be62-62be9dbd5ad3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:56.158966 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6dfa70e8-0533-4512-be62-62be9dbd5ad3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:56.277529 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-34397712-e381-4337-aa15-f2584291e1ef tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Flavor limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:22:56.278095 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-34397712-e381-4337-aa15-f2584291e1ef tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Image limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:22:56.278716 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-34397712-e381-4337-aa15-f2584291e1ef tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Flavor pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:22:56.279250 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-34397712-e381-4337-aa15-f2584291e1ef tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Image pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:22:56.279893 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-34397712-e381-4337-aa15-f2584291e1ef tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:22:56.288919 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-34397712-e381-4337-aa15-f2584291e1ef tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:56.289487 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-34397712-e381-4337-aa15-f2584291e1ef tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:56.290423 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-34397712-e381-4337-aa15-f2584291e1ef tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:56.290903 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-34397712-e381-4337-aa15-f2584291e1ef tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:56.312969 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-34397712-e381-4337-aa15-f2584291e1ef tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Getting quotas for project f027c3b75bc6430abd765a26269f9058. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:22:56.318302 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-34397712-e381-4337-aa15-f2584291e1ef tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Getting quotas for user b1302d3b8649407ca010f12aad7a6597 and project f027c3b75bc6430abd765a26269f9058. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:22:56.322838 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6dfa70e8-0533-4512-be62-62be9dbd5ad3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:56.331488 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-6dfa70e8-0533-4512-be62-62be9dbd5ad3 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd" status: 200 len: 1265 microversion: 2.1 time: 0.194838 May 27 15:22:56.331681 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-34397712-e381-4337-aa15-f2584291e1ef tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Going to run 1 instances... {{(pid=117743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:22:56.331978 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 500/975] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:56 2022] GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:56.335664 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-34397712-e381-4337-aa15-f2584291e1ef tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9407644-1f68-43e6-beb1-ce2085766180',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:22:56.384185 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-34397712-e381-4337-aa15-f2584291e1ef tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.701445 May 27 15:22:56.385166 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 476/976] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 15:22:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:22:56.405537 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e4421970-e9c2-4be9-8b68-8a4c08e5d455 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:56.406159 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e4421970-e9c2-4be9-8b68-8a4c08e5d455 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:56.485974 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-e4421970-e9c2-4be9-8b68-8a4c08e5d455 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:56.493597 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-e4421970-e9c2-4be9-8b68-8a4c08e5d455 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e" status: 200 len: 1242 microversion: 2.1 time: 0.092075 May 27 15:22:56.494172 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 501/977] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:56 2022] GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:56.605162 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-8569b46d-9717-472b-b9e5-bda7673d3d63 req-682b5481-63b6-46da-9649-b8bb4ab8850e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7e1edd-4f64-464a-b285-ff67845f9fbd", "name": "network-vif-plugged", "status": "completed", "tag": "9ba4f6ac-1735-4343-8ad5-506b1f2de62d"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:22:56.614075 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-8569b46d-9717-472b-b9e5-bda7673d3d63 req-682b5481-63b6-46da-9649-b8bb4ab8850e service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:56.614529 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-8569b46d-9717-472b-b9e5-bda7673d3d63 req-682b5481-63b6-46da-9649-b8bb4ab8850e service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:56.626174 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-8569b46d-9717-472b-b9e5-bda7673d3d63 req-682b5481-63b6-46da-9649-b8bb4ab8850e service nova] Creating event network-vif-plugged:9ba4f6ac-1735-4343-8ad5-506b1f2de62d for instance 1c7e1edd-4f64-464a-b285-ff67845f9fbd on hv-cinder-84254 May 27 15:22:56.632226 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-8569b46d-9717-472b-b9e5-bda7673d3d63 req-682b5481-63b6-46da-9649-b8bb4ab8850e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030602 May 27 15:22:56.632964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 477/978] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:22:57.348357 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-0ae7b3ab-2bce-49a8-915a-a1e023d6afe2 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:57.349042 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-0ae7b3ab-2bce-49a8-915a-a1e023d6afe2 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 1c7e1edd-4f64-464a-b285-ff67845f9fbd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:57.358840 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0ae7b3ab-2bce-49a8-915a-a1e023d6afe2 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:57.359315 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0ae7b3ab-2bce-49a8-915a-a1e023d6afe2 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:57.360097 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0ae7b3ab-2bce-49a8-915a-a1e023d6afe2 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:57.360557 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-0ae7b3ab-2bce-49a8-915a-a1e023d6afe2 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:57.512920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-0ae7b3ab-2bce-49a8-915a-a1e023d6afe2 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:57.513790 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9de550eb-96fa-4c07-a7bf-c4d1fb86c670 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:57.514803 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9de550eb-96fa-4c07-a7bf-c4d1fb86c670 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:57.521511 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-0ae7b3ab-2bce-49a8-915a-a1e023d6afe2 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd" status: 200 len: 1265 microversion: 2.1 time: 0.176680 May 27 15:22:57.522377 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 502/979] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:57 2022] GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:57.522567 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9de550eb-96fa-4c07-a7bf-c4d1fb86c670 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:57.523059 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9de550eb-96fa-4c07-a7bf-c4d1fb86c670 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:57.523839 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9de550eb-96fa-4c07-a7bf-c4d1fb86c670 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:57.524670 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9de550eb-96fa-4c07-a7bf-c4d1fb86c670 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:57.591109 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-9de550eb-96fa-4c07-a7bf-c4d1fb86c670 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:57.598949 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9de550eb-96fa-4c07-a7bf-c4d1fb86c670 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e" status: 200 len: 1294 microversion: 2.1 time: 0.090951 May 27 15:22:57.599539 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 478/980] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:57 2022] GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:22:58.538536 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-d27ee1f3-23b6-4de7-85a2-3ef793764d10 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:58.539348 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-d27ee1f3-23b6-4de7-85a2-3ef793764d10 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 1c7e1edd-4f64-464a-b285-ff67845f9fbd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:58.545724 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d27ee1f3-23b6-4de7-85a2-3ef793764d10 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:58.546262 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d27ee1f3-23b6-4de7-85a2-3ef793764d10 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:58.547305 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d27ee1f3-23b6-4de7-85a2-3ef793764d10 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:58.547816 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-d27ee1f3-23b6-4de7-85a2-3ef793764d10 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:58.616473 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-968cac74-a748-4104-bca2-1065ffece663 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:58.617875 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-968cac74-a748-4104-bca2-1065ffece663 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:58.624703 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-968cac74-a748-4104-bca2-1065ffece663 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:58.625193 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-968cac74-a748-4104-bca2-1065ffece663 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:58.626097 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-968cac74-a748-4104-bca2-1065ffece663 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:58.626538 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-968cac74-a748-4104-bca2-1065ffece663 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:58.696033 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-968cac74-a748-4104-bca2-1065ffece663 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:58.703427 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-968cac74-a748-4104-bca2-1065ffece663 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e" status: 200 len: 1300 microversion: 2.1 time: 0.090939 May 27 15:22:58.703992 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 479/981] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:58 2022] GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:58.713300 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-d27ee1f3-23b6-4de7-85a2-3ef793764d10 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:58.721104 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-d27ee1f3-23b6-4de7-85a2-3ef793764d10 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd" status: 200 len: 1451 microversion: 2.1 time: 0.186527 May 27 15:22:58.721663 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 503/982] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:58 2022] GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd => generated 1451 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:58.737773 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-37baf498-2072-4d8e-bfda-8ff497d67108 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:58.738412 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-37baf498-2072-4d8e-bfda-8ff497d67108 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 1c7e1edd-4f64-464a-b285-ff67845f9fbd] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:58.744635 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-37baf498-2072-4d8e-bfda-8ff497d67108 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:58.745080 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-37baf498-2072-4d8e-bfda-8ff497d67108 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:58.745843 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-37baf498-2072-4d8e-bfda-8ff497d67108 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:58.746275 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-37baf498-2072-4d8e-bfda-8ff497d67108 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:58.879047 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-37baf498-2072-4d8e-bfda-8ff497d67108 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:58.887714 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-37baf498-2072-4d8e-bfda-8ff497d67108 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd" status: 200 len: 1451 microversion: 2.1 time: 0.153871 May 27 15:22:58.888295 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 480/983] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:58 2022] GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:22:59.721655 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-a1be7043-e274-44e1-bfad-ea643d765cc1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:22:59.723009 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-a1be7043-e274-44e1-bfad-ea643d765cc1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:22:59.730477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a1be7043-e274-44e1-bfad-ea643d765cc1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:59.731264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a1be7043-e274-44e1-bfad-ea643d765cc1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:59.732294 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a1be7043-e274-44e1-bfad-ea643d765cc1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:22:59.732947 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-a1be7043-e274-44e1-bfad-ea643d765cc1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:22:59.976530 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-a1be7043-e274-44e1-bfad-ea643d765cc1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:22:59.985494 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-a1be7043-e274-44e1-bfad-ea643d765cc1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e" status: 200 len: 1367 microversion: 2.1 time: 0.267832 May 27 15:22:59.987609 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 504/984] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:22:59 2022] GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:00.178019 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-58096f58-e46f-4b76-9a8c-58c42a64c567 req-e2038804-a4eb-43a4-b5ff-728ec8e406c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e", "tag": "0f125be5-109c-4c09-aa99-7071bcb30bbc"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:00.220397 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-58096f58-e46f-4b76-9a8c-58c42a64c567 req-e2038804-a4eb-43a4-b5ff-728ec8e406c0 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:00.223987 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-58096f58-e46f-4b76-9a8c-58c42a64c567 req-e2038804-a4eb-43a4-b5ff-728ec8e406c0 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:00.237664 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-58096f58-e46f-4b76-9a8c-58c42a64c567 req-e2038804-a4eb-43a4-b5ff-728ec8e406c0 service nova] Creating event network-changed:0f125be5-109c-4c09-aa99-7071bcb30bbc for instance 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e on hv-cinder-84254 May 27 15:23:00.246636 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-58096f58-e46f-4b76-9a8c-58c42a64c567 req-e2038804-a4eb-43a4-b5ff-728ec8e406c0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075344 May 27 15:23:00.248130 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 481/985] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:23:01.003958 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-5f1f1482-caad-44d4-b6c0-7f58f1543975 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:01.004672 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-5f1f1482-caad-44d4-b6c0-7f58f1543975 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:01.011409 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5f1f1482-caad-44d4-b6c0-7f58f1543975 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:01.011864 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5f1f1482-caad-44d4-b6c0-7f58f1543975 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:01.012644 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5f1f1482-caad-44d4-b6c0-7f58f1543975 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:01.013112 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-5f1f1482-caad-44d4-b6c0-7f58f1543975 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:01.167712 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-790bb6f6-dc6d-4252-be0c-58839b64a379 req-97bb6a7c-471e-4149-9daa-a470d5cb3d32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c7e1edd-4f64-464a-b285-ff67845f9fbd", "tag": "9ba4f6ac-1735-4343-8ad5-506b1f2de62d"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:01.176254 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-790bb6f6-dc6d-4252-be0c-58839b64a379 req-97bb6a7c-471e-4149-9daa-a470d5cb3d32 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:01.176826 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-790bb6f6-dc6d-4252-be0c-58839b64a379 req-97bb6a7c-471e-4149-9daa-a470d5cb3d32 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:01.188399 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-5f1f1482-caad-44d4-b6c0-7f58f1543975 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:01.189712 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-790bb6f6-dc6d-4252-be0c-58839b64a379 req-97bb6a7c-471e-4149-9daa-a470d5cb3d32 service nova] Creating event network-changed:9ba4f6ac-1735-4343-8ad5-506b1f2de62d for instance 1c7e1edd-4f64-464a-b285-ff67845f9fbd on hv-cinder-84254 May 27 15:23:01.196510 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-790bb6f6-dc6d-4252-be0c-58839b64a379 req-97bb6a7c-471e-4149-9daa-a470d5cb3d32 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032603 May 27 15:23:01.199546 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-5f1f1482-caad-44d4-b6c0-7f58f1543975 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e" status: 200 len: 1367 microversion: 2.1 time: 0.199346 May 27 15:23:01.200133 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 482/986] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:23:01.200996 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 505/987] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:23:00 2022] GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:02.218169 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-60d96cf9-c60f-4c4c-9068-3f5eec70e246 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:02.219463 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-60d96cf9-c60f-4c4c-9068-3f5eec70e246 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:02.227864 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-60d96cf9-c60f-4c4c-9068-3f5eec70e246 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:02.228511 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-60d96cf9-c60f-4c4c-9068-3f5eec70e246 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:02.229452 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-60d96cf9-c60f-4c4c-9068-3f5eec70e246 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:02.230036 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-60d96cf9-c60f-4c4c-9068-3f5eec70e246 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:02.370104 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-60d96cf9-c60f-4c4c-9068-3f5eec70e246 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:02.378373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-60d96cf9-c60f-4c4c-9068-3f5eec70e246 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e" status: 200 len: 1367 microversion: 2.1 time: 0.165278 May 27 15:23:02.379005 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 483/988] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:23:02 2022] GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:03.395700 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-abf32739-13f1-4b94-8718-22ee667755f8 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:03.396581 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-abf32739-13f1-4b94-8718-22ee667755f8 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:03.403104 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-abf32739-13f1-4b94-8718-22ee667755f8 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:03.403558 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-abf32739-13f1-4b94-8718-22ee667755f8 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:03.404316 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-abf32739-13f1-4b94-8718-22ee667755f8 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:03.404749 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-abf32739-13f1-4b94-8718-22ee667755f8 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:03.537567 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-abf32739-13f1-4b94-8718-22ee667755f8 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:03.540992 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:03.547522 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-abf32739-13f1-4b94-8718-22ee667755f8 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e" status: 200 len: 1367 microversion: 2.1 time: 0.155729 May 27 15:23:03.548268 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 506/989] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:23:03 2022] GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:04.564484 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-879ad186-eafc-410a-bb46-bf4d4c18ccde tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:04.565131 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-879ad186-eafc-410a-bb46-bf4d4c18ccde tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:04.574430 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-879ad186-eafc-410a-bb46-bf4d4c18ccde tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:04.575004 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-879ad186-eafc-410a-bb46-bf4d4c18ccde tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:04.575847 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-879ad186-eafc-410a-bb46-bf4d4c18ccde tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:04.576289 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-879ad186-eafc-410a-bb46-bf4d4c18ccde tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:04.707508 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-879ad186-eafc-410a-bb46-bf4d4c18ccde tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:04.714936 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-879ad186-eafc-410a-bb46-bf4d4c18ccde tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e" status: 200 len: 1367 microversion: 2.1 time: 0.154552 May 27 15:23:04.715506 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 484/990] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:23:04 2022] GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:05.731989 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-32203abd-9bcb-4ce9-ba5c-844fa2c08c77 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:05.732604 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-32203abd-9bcb-4ce9-ba5c-844fa2c08c77 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:05.742288 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-32203abd-9bcb-4ce9-ba5c-844fa2c08c77 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:05.742732 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-32203abd-9bcb-4ce9-ba5c-844fa2c08c77 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:05.743529 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-32203abd-9bcb-4ce9-ba5c-844fa2c08c77 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:05.743967 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-32203abd-9bcb-4ce9-ba5c-844fa2c08c77 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:05.870561 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-32203abd-9bcb-4ce9-ba5c-844fa2c08c77 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:05.877982 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-32203abd-9bcb-4ce9-ba5c-844fa2c08c77 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e" status: 200 len: 1367 microversion: 2.1 time: 0.149868 May 27 15:23:05.879307 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 507/991] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:23:05 2022] GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:06.043367 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-6de8f951-ccfd-4f03-b3be-3daace38a07d req-03590e36-7e58-47e2-8e75-b1522cdbda1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e", "name": "network-vif-plugged", "status": "completed", "tag": "0f125be5-109c-4c09-aa99-7071bcb30bbc"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:06.053317 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-6de8f951-ccfd-4f03-b3be-3daace38a07d req-03590e36-7e58-47e2-8e75-b1522cdbda1a service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:06.053798 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-6de8f951-ccfd-4f03-b3be-3daace38a07d req-03590e36-7e58-47e2-8e75-b1522cdbda1a service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:06.065801 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-6de8f951-ccfd-4f03-b3be-3daace38a07d req-03590e36-7e58-47e2-8e75-b1522cdbda1a service nova] Creating event network-vif-plugged:0f125be5-109c-4c09-aa99-7071bcb30bbc for instance 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e on hv-cinder-84254 May 27 15:23:06.071786 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-6de8f951-ccfd-4f03-b3be-3daace38a07d req-03590e36-7e58-47e2-8e75-b1522cdbda1a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032145 May 27 15:23:06.072445 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 485/992] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:23:06.896021 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e04708c0-d36e-420e-9fdb-0ab167c4a6e4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:06.896726 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e04708c0-d36e-420e-9fdb-0ab167c4a6e4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:06.898350 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=2 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:06.904254 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e04708c0-d36e-420e-9fdb-0ab167c4a6e4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:06.905315 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e04708c0-d36e-420e-9fdb-0ab167c4a6e4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:06.906083 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e04708c0-d36e-420e-9fdb-0ab167c4a6e4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:06.906518 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e04708c0-d36e-420e-9fdb-0ab167c4a6e4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:07.039427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-e04708c0-d36e-420e-9fdb-0ab167c4a6e4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:07.046918 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-e04708c0-d36e-420e-9fdb-0ab167c4a6e4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e" status: 200 len: 1367 microversion: 2.1 time: 0.155384 May 27 15:23:07.047469 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 508/993] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:23:06 2022] GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:08.060939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=2 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:08.061895 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=10 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:08.067193 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b795025b-d691-4875-a461-01f4295adfad tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:08.067896 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b795025b-d691-4875-a461-01f4295adfad tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:08.069662 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:08.076672 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b795025b-d691-4875-a461-01f4295adfad tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:08.077126 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b795025b-d691-4875-a461-01f4295adfad tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:08.077897 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b795025b-d691-4875-a461-01f4295adfad tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:08.078337 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b795025b-d691-4875-a461-01f4295adfad tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:08.082779 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=93 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:08.212190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b795025b-d691-4875-a461-01f4295adfad tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:08.220364 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b795025b-d691-4875-a461-01f4295adfad tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e" status: 200 len: 1555 microversion: 2.1 time: 0.160347 May 27 15:23:08.220971 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 486/994] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:23:08 2022] GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:08.237313 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-9f9ab24f-8040-473a-89c1-0d3b9375bcc9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:08.237816 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-9f9ab24f-8040-473a-89c1-0d3b9375bcc9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:08.240168 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:08.245427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9f9ab24f-8040-473a-89c1-0d3b9375bcc9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:08.245874 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9f9ab24f-8040-473a-89c1-0d3b9375bcc9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:08.246636 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9f9ab24f-8040-473a-89c1-0d3b9375bcc9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:08.247109 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9f9ab24f-8040-473a-89c1-0d3b9375bcc9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:08.324836 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-9f9ab24f-8040-473a-89c1-0d3b9375bcc9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091311 May 27 15:23:08.325484 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 509/995] 10.222.0.50 () {58 vars in 1274 bytes} [Fri May 27 15:23:08 2022] GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:23:09.252332 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-b410fc56-dccc-46ef-98b6-c5ee60b701cd req-cbf47350-96cd-4e5b-b400-13691b9d39ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e", "tag": "0f125be5-109c-4c09-aa99-7071bcb30bbc"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:09.261618 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-b410fc56-dccc-46ef-98b6-c5ee60b701cd req-cbf47350-96cd-4e5b-b400-13691b9d39ac service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:09.262098 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-b410fc56-dccc-46ef-98b6-c5ee60b701cd req-cbf47350-96cd-4e5b-b400-13691b9d39ac service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:09.273445 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-b410fc56-dccc-46ef-98b6-c5ee60b701cd req-cbf47350-96cd-4e5b-b400-13691b9d39ac service nova] Creating event network-changed:0f125be5-109c-4c09-aa99-7071bcb30bbc for instance 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e on hv-cinder-84254 May 27 15:23:09.278314 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-b410fc56-dccc-46ef-98b6-c5ee60b701cd req-cbf47350-96cd-4e5b-b400-13691b9d39ac service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029627 May 27 15:23:09.279059 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 487/996] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:23:18.608959 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-416991e2-805c-4157-8524-74a72e9539ae tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:18.609502 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-416991e2-805c-4157-8524-74a72e9539ae tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:18.612508 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-d849751c-7871-4360-8b8f-88bcea18477e req-2a21721e-c86b-413e-9184-39a7a024997b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e4355e-ea71-44c5-90ae-0ec0406a5d6e", "tag": "58c057d0-cc07-4dc4-ab97-0024ba4d6dfd"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:18.616834 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:18.618299 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=16 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:18.620832 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-416991e2-805c-4157-8524-74a72e9539ae tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:18.621590 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-416991e2-805c-4157-8524-74a72e9539ae tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:18.622596 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-416991e2-805c-4157-8524-74a72e9539ae tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:18.623296 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-416991e2-805c-4157-8524-74a72e9539ae tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:18.624737 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-d849751c-7871-4360-8b8f-88bcea18477e req-2a21721e-c86b-413e-9184-39a7a024997b service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:18.625180 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-d849751c-7871-4360-8b8f-88bcea18477e req-2a21721e-c86b-413e-9184-39a7a024997b service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:18.639777 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-d849751c-7871-4360-8b8f-88bcea18477e req-2a21721e-c86b-413e-9184-39a7a024997b service nova] Creating event network-changed:58c057d0-cc07-4dc4-ab97-0024ba4d6dfd for instance 16e4355e-ea71-44c5-90ae-0ec0406a5d6e on hv-cinder-84254 May 27 15:23:18.647359 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-d849751c-7871-4360-8b8f-88bcea18477e req-2a21721e-c86b-413e-9184-39a7a024997b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039121 May 27 15:23:18.647969 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 488/997] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:23:18.654467 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-416991e2-805c-4157-8524-74a72e9539ae tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Going to try to terminate instance {{(pid=117742) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:23:18.768922 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-416991e2-805c-4157-8524-74a72e9539ae tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "DELETE /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 204 len: 0 microversion: 2.1 time: 0.163223 May 27 15:23:18.769992 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 510/998] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:23:18 2022] DELETE /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:23:18.779462 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-93f4c42c-0bb3-453c-b72b-7639c462525f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:18.780142 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-93f4c42c-0bb3-453c-b72b-7639c462525f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:18.787324 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-93f4c42c-0bb3-453c-b72b-7639c462525f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:18.787768 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-93f4c42c-0bb3-453c-b72b-7639c462525f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:18.788547 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-93f4c42c-0bb3-453c-b72b-7639c462525f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:18.788977 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-93f4c42c-0bb3-453c-b72b-7639c462525f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:18.943261 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-93f4c42c-0bb3-453c-b72b-7639c462525f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:18.960754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-93f4c42c-0bb3-453c-b72b-7639c462525f tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1569 microversion: 2.1 time: 0.185356 May 27 15:23:18.961630 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 489/999] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:23:18 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:20.086361 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-03d03296-335c-43fd-a123-eded7708a1dc tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:20.087554 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-03d03296-335c-43fd-a123-eded7708a1dc tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:20.093123 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-03d03296-335c-43fd-a123-eded7708a1dc tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:20.093568 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-03d03296-335c-43fd-a123-eded7708a1dc tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:20.094331 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-03d03296-335c-43fd-a123-eded7708a1dc tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:20.095049 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-03d03296-335c-43fd-a123-eded7708a1dc tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:20.228269 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-03d03296-335c-43fd-a123-eded7708a1dc tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:20.236192 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-03d03296-335c-43fd-a123-eded7708a1dc tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1569 microversion: 2.1 time: 0.259661 May 27 15:23:20.236764 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 511/1000] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:23:19 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1569 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:21.143323 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-3fac1c8a-98b3-4b6b-a59c-e46b88c5515f req-4aa87412-3cb1-4829-a709-5a039aa6ea64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e4355e-ea71-44c5-90ae-0ec0406a5d6e", "name": "network-vif-deleted", "tag": "58c057d0-cc07-4dc4-ab97-0024ba4d6dfd"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:21.152473 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-3fac1c8a-98b3-4b6b-a59c-e46b88c5515f req-4aa87412-3cb1-4829-a709-5a039aa6ea64 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:21.152905 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-3fac1c8a-98b3-4b6b-a59c-e46b88c5515f req-4aa87412-3cb1-4829-a709-5a039aa6ea64 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:21.165084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-3fac1c8a-98b3-4b6b-a59c-e46b88c5515f req-4aa87412-3cb1-4829-a709-5a039aa6ea64 service nova] Creating event network-vif-deleted:58c057d0-cc07-4dc4-ab97-0024ba4d6dfd for instance 16e4355e-ea71-44c5-90ae-0ec0406a5d6e on hv-cinder-84254 May 27 15:23:21.169701 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-3fac1c8a-98b3-4b6b-a59c-e46b88c5515f req-4aa87412-3cb1-4829-a709-5a039aa6ea64 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030052 May 27 15:23:21.170447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 490/1001] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:23:21.253417 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-6778ef34-686b-46c2-a047-4f9b59d32f06 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:21.254147 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-6778ef34-686b-46c2-a047-4f9b59d32f06 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:21.261639 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6778ef34-686b-46c2-a047-4f9b59d32f06 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:21.262077 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6778ef34-686b-46c2-a047-4f9b59d32f06 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:21.262833 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6778ef34-686b-46c2-a047-4f9b59d32f06 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:21.263278 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6778ef34-686b-46c2-a047-4f9b59d32f06 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:21.330557 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6778ef34-686b-46c2-a047-4f9b59d32f06 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:21.338792 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-6778ef34-686b-46c2-a047-4f9b59d32f06 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1220 microversion: 2.1 time: 0.089208 May 27 15:23:21.339478 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 512/1002] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:23:21 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:22.356743 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-784ab31f-8cfb-4d3b-a4d5-1f5619054ae3 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:22.357458 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-784ab31f-8cfb-4d3b-a4d5-1f5619054ae3 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:22.363664 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-784ab31f-8cfb-4d3b-a4d5-1f5619054ae3 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:22.364117 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-784ab31f-8cfb-4d3b-a4d5-1f5619054ae3 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:22.364871 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-784ab31f-8cfb-4d3b-a4d5-1f5619054ae3 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:22.365298 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-784ab31f-8cfb-4d3b-a4d5-1f5619054ae3 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:22.398781 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-784ab31f-8cfb-4d3b-a4d5-1f5619054ae3 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:22.399319 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-784ab31f-8cfb-4d3b-a4d5-1f5619054ae3 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:22.399821 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.objects.instance [None req-784ab31f-8cfb-4d3b-a4d5-1f5619054ae3 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lazy-loading 'fault' on Instance uuid 16e4355e-ea71-44c5-90ae-0ec0406a5d6e {{(pid=117743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:23:22.443199 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-784ab31f-8cfb-4d3b-a4d5-1f5619054ae3 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f52a9eabb6f84931b8f0af715af9eb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '520d6685a60d4d9b8b7415d11b01a8f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:23:22.450003 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-784ab31f-8cfb-4d3b-a4d5-1f5619054ae3 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 200 len: 1179 microversion: 2.1 time: 0.097984 May 27 15:23:22.450567 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 491/1003] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:23:22 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 1179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:23:23.466933 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b1b7dfc6-71e9-40e0-81f7-4e869807b062 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:23.467481 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-b1b7dfc6-71e9-40e0-81f7-4e869807b062 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] [instance: 16e4355e-ea71-44c5-90ae-0ec0406a5d6e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:23.474696 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b1b7dfc6-71e9-40e0-81f7-4e869807b062 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:23.475167 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b1b7dfc6-71e9-40e0-81f7-4e869807b062 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:23.476025 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b1b7dfc6-71e9-40e0-81f7-4e869807b062 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:23.476412 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-b1b7dfc6-71e9-40e0-81f7-4e869807b062 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:23.490808 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-b1b7dfc6-71e9-40e0-81f7-4e869807b062 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] HTTP exception thrown: Instance 16e4355e-ea71-44c5-90ae-0ec0406a5d6e could not be found. May 27 15:23:23.492477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b1b7dfc6-71e9-40e0-81f7-4e869807b062 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Request method failure captured: May 27 15:23:23.492477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e HTTP/1.1 May 27 15:23:23.492477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:23:23.492477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:23:23.492477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:23:23.492477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:23:23.492477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:23:23.492477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:23:23.492477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:23:23.492477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:23:23.492477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOuzBoADBVBdMfJAhAdViPlfve4mkLh8Vvh72VtP0w8fEXbVVN-H2MvNtI0HVkrQdoVRf-yEjjxuCvEHAD7U88JVwk5CJevbgpJEAOKHYPIWEnrOFedMtRMvTGNxvt5KMJdnBqo3Oyh85aCEqQZsVYZRpS3n3McvafqvA8QEFV3NtVM May 27 15:23:23.492477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:23:23.492477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:23:23.492477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:23:23.492477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:23:23.492477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:23:23.492477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:23:23.492477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: 520d6685a60d4d9b8b7415d11b01a8f0 May 27 15:23:23.492477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-TestShelveInstance-1061129490 May 27 15:23:23.492477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:23:23.492477 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:23:23.494229 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/520d6685a60d4d9b8b7415d11b01a8f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_520d6685a60d4d9b8b7415d11b01a8f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/520d6685a60d4d9b8b7415d11b01a8f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/520d6685a60d4d9b8b7415d11b01a8f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:23:23.494229 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-TestShelveInstance-1061129490 May 27 15:23:23.494229 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: 520d6685a60d4d9b8b7415d11b01a8f0 May 27 15:23:23.494229 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-TestShelveInstance-1061129490 May 27 15:23:23.494229 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-TestShelveInstance-1061129490-project May 27 15:23:23.494229 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:23:23.494229 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:23:23.494229 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: f52a9eabb6f84931b8f0af715af9eb36 May 27 15:23:23.494229 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-TestShelveInstance-1061129490-project May 27 15:23:23.494229 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:23:23.494229 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance 16e4355e-ea71-44c5-90ae-0ec0406a5d6e could not be found. May 27 15:23:23.494229 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': '16e4355e-ea71-44c5-90ae-0ec0406a5d6e'} May 27 15:23:23.495317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:23:23.495317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:23.495317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:23:23.495317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:23:23.495317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:23:23.495317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:23:23.495317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:23:23.495317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:23:23.495317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:23:23.495317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:23:23.495317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e4355e-ea71-44c5-90ae-0ec0406a5d6e could not be found. May 27 15:23:23.495317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:23:23.495317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:23.495317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:23:23.495317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:23.495317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:23.495317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:23.495317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:23:23.495317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:23:23.495317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:23:23.496986 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:23:23.496986 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:23:23.496986 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:23:23.496986 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:23:23.496986 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:23:23.496986 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:23:23.496986 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:23:23.496986 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e4355e-ea71-44c5-90ae-0ec0406a5d6e could not be found. May 27 15:23:23.496986 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:23:23.496986 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:23:23.496986 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:23:23.496986 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:23:23.496986 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:23:23.496986 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:23:23.496986 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:23:23.496986 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:23:23.496986 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e4355e-ea71-44c5-90ae-0ec0406a5d6e could not be found. May 27 15:23:23.496986 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:23:23.498575 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-b1b7dfc6-71e9-40e0-81f7-4e869807b062 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Returning 404 to user: Instance 16e4355e-ea71-44c5-90ae-0ec0406a5d6e could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:23:23.498575 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-b1b7dfc6-71e9-40e0-81f7-4e869807b062 tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e" status: 404 len: 111 microversion: 2.1 time: 0.030947 May 27 15:23:23.498575 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 513/1004] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:23:23 2022] GET /compute/v2.1/servers/16e4355e-ea71-44c5-90ae-0ec0406a5d6e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:23:23.654791 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-344ad043-23b4-41b9-9c8d-34a672c7800b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] Calling method '.version_select at 0x7f57e20e63a0>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:23.674789 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-344ad043-23b4-41b9-9c8d-34a672c7800b tempest-TestShelveInstance-1061129490 tempest-TestShelveInstance-1061129490-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1482917948" status: 202 len: 0 microversion: 2.1 time: 0.023883 May 27 15:23:23.675812 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 492/1005] 10.222.0.50 () {58 vars in 1253 bytes} [Fri May 27 15:23:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1482917948 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:23:52.954494 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-1a0ea469-778e-44c6-9813-d9b29c7a9ce9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:23:52.955107 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-1a0ea469-778e-44c6-9813-d9b29c7a9ce9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:52.957300 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:52.957941 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:52.965200 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1a0ea469-778e-44c6-9813-d9b29c7a9ce9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:52.965668 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1a0ea469-778e-44c6-9813-d9b29c7a9ce9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:52.966432 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1a0ea469-778e-44c6-9813-d9b29c7a9ce9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:52.966891 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1a0ea469-778e-44c6-9813-d9b29c7a9ce9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:52.992128 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-1a0ea469-778e-44c6-9813-d9b29c7a9ce9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e/ips" status: 200 len: 147 microversion: 2.1 time: 0.041434 May 27 15:23:52.992741 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 514/1006] 10.222.0.50 () {58 vars in 1247 bytes} [Fri May 27 15:23:52 2022] GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e/ips => generated 147 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:23:54.337700 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=25 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:54.338435 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:23:54.342889 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9186a8f0-40cc-4a48-a487-3a312e9e84d9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a63f5c00-1d56-41b9-9327-b3563b987ff0"}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:23:54.343956 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9186a8f0-40cc-4a48-a487-3a312e9e84d9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:23:54.354666 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9186a8f0-40cc-4a48-a487-3a312e9e84d9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:54.355209 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9186a8f0-40cc-4a48-a487-3a312e9e84d9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:54.356483 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9186a8f0-40cc-4a48-a487-3a312e9e84d9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:23:54.356935 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9186a8f0-40cc-4a48-a487-3a312e9e84d9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:23:54.613363 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9186a8f0-40cc-4a48-a487-3a312e9e84d9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "POST /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277001 May 27 15:23:54.614319 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 493/1007] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 15:23:54 2022] POST /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:02.122616 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-5a6a55d4-1fb4-46c7-a202-10b255aa50d9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Action: 'create', calling method: .version_select at 0x7f57e16cc5e0>, body: {"keypair": {"name": "tempest-keypair-1677654983", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHt/fnbhfOqNqjpBC0Y2D+3CFsafHlTf58RXZuFTQ8K/g88Cp0OuHa0hV/R/GLiuSAlCwPVJfqVnQD2q+nIUmLKknKf9XVSKV+2YdzjkEjZzkFO6F6sKGwL7EAnbsbtrGQ=="}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:02.137711 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-5a6a55d4-1fb4-46c7-a202-10b255aa50d9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Getting quotas for project f027c3b75bc6430abd765a26269f9058. Resources: {'key_pairs'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:24:02.141568 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-5a6a55d4-1fb4-46c7-a202-10b255aa50d9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Getting quotas for user b1302d3b8649407ca010f12aad7a6597 and project f027c3b75bc6430abd765a26269f9058. Resources: {'key_pairs'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:24:02.164434 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-5a6a55d4-1fb4-46c7-a202-10b255aa50d9 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045546 May 27 15:24:02.165034 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 515/1008] 10.222.0.50 () {60 vars in 1158 bytes} [Fri May 27 15:24:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:03.425295 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-79391432-daaa-44c7-9d2e-6dc30ae5363a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-759657262", "imageRef": "a9407644-1f68-43e6-beb1-ce2085766180", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b7857e3-255b-417e-82ed-fcdb2806f57d"}], "security_groups": [{"name": "tempest-securitygroup--6807327"}], "key_name": "tempest-keypair-1677654983", "user_data": "}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:03.528601 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.network.neutron [None req-79391432-daaa-44c7-9d2e-6dc30ae5363a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] validate_networks() for [('6b7857e3-255b-417e-82ed-fcdb2806f57d', None, None, None, None, None)] {{(pid=117743) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:24:03.891244 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-79391432-daaa-44c7-9d2e-6dc30ae5363a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Flavor limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:24:03.891663 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-79391432-daaa-44c7-9d2e-6dc30ae5363a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Image limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:24:03.892132 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-79391432-daaa-44c7-9d2e-6dc30ae5363a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Flavor pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:24:03.892535 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-79391432-daaa-44c7-9d2e-6dc30ae5363a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Image pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:24:03.892938 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-79391432-daaa-44c7-9d2e-6dc30ae5363a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:24:03.902147 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-79391432-daaa-44c7-9d2e-6dc30ae5363a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:03.902587 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-79391432-daaa-44c7-9d2e-6dc30ae5363a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:03.903401 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-79391432-daaa-44c7-9d2e-6dc30ae5363a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:03.903833 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-79391432-daaa-44c7-9d2e-6dc30ae5363a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:03.920656 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-79391432-daaa-44c7-9d2e-6dc30ae5363a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Getting quotas for project f027c3b75bc6430abd765a26269f9058. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:24:03.924553 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-79391432-daaa-44c7-9d2e-6dc30ae5363a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Getting quotas for user b1302d3b8649407ca010f12aad7a6597 and project f027c3b75bc6430abd765a26269f9058. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:24:03.935403 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-79391432-daaa-44c7-9d2e-6dc30ae5363a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Going to run 1 instances... {{(pid=117743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:24:03.937732 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-79391432-daaa-44c7-9d2e-6dc30ae5363a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: df6c7382-2e3c-43bd-b678-327aea25a957] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9407644-1f68-43e6-beb1-ce2085766180',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:24:03.984950 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-79391432-daaa-44c7-9d2e-6dc30ae5363a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.564338 May 27 15:24:03.985530 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 494/1009] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 15:24:03 2022] POST /compute/v2.1/servers => generated 399 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:24:03.992668 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=4 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:03.997818 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-ced057d1-b97e-488d-ac7f-5ea19999ee2e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:03.998424 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-ced057d1-b97e-488d-ac7f-5ea19999ee2e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: df6c7382-2e3c-43bd-b678-327aea25a957] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:04.052595 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-ced057d1-b97e-488d-ac7f-5ea19999ee2e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:04.059340 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-ced057d1-b97e-488d-ac7f-5ea19999ee2e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957" status: 200 len: 1241 microversion: 2.1 time: 0.067784 May 27 15:24:04.059901 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 516/1010] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:03 2022] GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:05.076966 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-25e26b83-b5bb-4aba-82be-71c1998f7a09 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:05.077558 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-25e26b83-b5bb-4aba-82be-71c1998f7a09 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: df6c7382-2e3c-43bd-b678-327aea25a957] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:05.085795 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-25e26b83-b5bb-4aba-82be-71c1998f7a09 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:05.086251 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-25e26b83-b5bb-4aba-82be-71c1998f7a09 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:05.087066 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-25e26b83-b5bb-4aba-82be-71c1998f7a09 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:05.087505 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-25e26b83-b5bb-4aba-82be-71c1998f7a09 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:05.158431 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-25e26b83-b5bb-4aba-82be-71c1998f7a09 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:05.165537 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-25e26b83-b5bb-4aba-82be-71c1998f7a09 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957" status: 200 len: 1301 microversion: 2.1 time: 0.092893 May 27 15:24:05.166656 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 495/1011] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:05 2022] GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957 => generated 1301 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:06.183889 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-17a6871f-bdbf-4422-8cbf-e6f9905fcae3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:06.184633 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-17a6871f-bdbf-4422-8cbf-e6f9905fcae3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: df6c7382-2e3c-43bd-b678-327aea25a957] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:06.191166 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-17a6871f-bdbf-4422-8cbf-e6f9905fcae3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:06.191699 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-17a6871f-bdbf-4422-8cbf-e6f9905fcae3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:06.192474 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-17a6871f-bdbf-4422-8cbf-e6f9905fcae3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:06.192940 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-17a6871f-bdbf-4422-8cbf-e6f9905fcae3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:06.324650 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-17a6871f-bdbf-4422-8cbf-e6f9905fcae3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:06.332377 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-17a6871f-bdbf-4422-8cbf-e6f9905fcae3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957" status: 200 len: 1364 microversion: 2.1 time: 0.153311 May 27 15:24:06.332946 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 517/1012] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:06 2022] GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:06.642585 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-763fd152-8c04-4235-9a54-83ba98868eb9 req-49c129b7-ca76-46c2-af5f-5cd0367df555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df6c7382-2e3c-43bd-b678-327aea25a957", "tag": "d1beeeb3-dbd3-48ae-b2ed-e700b9716741"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:06.654100 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-763fd152-8c04-4235-9a54-83ba98868eb9 req-49c129b7-ca76-46c2-af5f-5cd0367df555 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:06.654550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-763fd152-8c04-4235-9a54-83ba98868eb9 req-49c129b7-ca76-46c2-af5f-5cd0367df555 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:06.680769 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-763fd152-8c04-4235-9a54-83ba98868eb9 req-49c129b7-ca76-46c2-af5f-5cd0367df555 service nova] Creating event network-changed:d1beeeb3-dbd3-48ae-b2ed-e700b9716741 for instance df6c7382-2e3c-43bd-b678-327aea25a957 on hv-cinder-84254 May 27 15:24:06.686092 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-763fd152-8c04-4235-9a54-83ba98868eb9 req-49c129b7-ca76-46c2-af5f-5cd0367df555 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047134 May 27 15:24:06.687109 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 496/1013] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:07.350425 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-414c84d0-089b-4030-b137-e3006a31aa75 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:07.351707 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-414c84d0-089b-4030-b137-e3006a31aa75 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: df6c7382-2e3c-43bd-b678-327aea25a957] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:07.358321 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-414c84d0-089b-4030-b137-e3006a31aa75 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:07.358714 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-414c84d0-089b-4030-b137-e3006a31aa75 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:07.359520 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-414c84d0-089b-4030-b137-e3006a31aa75 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:07.359958 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-414c84d0-089b-4030-b137-e3006a31aa75 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:07.487815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-414c84d0-089b-4030-b137-e3006a31aa75 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:07.495653 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-414c84d0-089b-4030-b137-e3006a31aa75 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957" status: 200 len: 1364 microversion: 2.1 time: 0.149107 May 27 15:24:07.496216 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 518/1014] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:07 2022] GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:08.514144 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-601bbd88-bfb3-46de-adfa-913eca85c4a7 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:08.514835 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-601bbd88-bfb3-46de-adfa-913eca85c4a7 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: df6c7382-2e3c-43bd-b678-327aea25a957] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:08.520965 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-601bbd88-bfb3-46de-adfa-913eca85c4a7 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:08.521410 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-601bbd88-bfb3-46de-adfa-913eca85c4a7 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:08.522168 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-601bbd88-bfb3-46de-adfa-913eca85c4a7 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:08.522624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-601bbd88-bfb3-46de-adfa-913eca85c4a7 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:08.655751 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-601bbd88-bfb3-46de-adfa-913eca85c4a7 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:08.663215 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-601bbd88-bfb3-46de-adfa-913eca85c4a7 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957" status: 200 len: 1364 microversion: 2.1 time: 0.153724 May 27 15:24:08.663728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 497/1015] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:08 2022] GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:09.680691 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-902a242b-e733-4517-a416-24fc10d3907a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:09.681306 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-902a242b-e733-4517-a416-24fc10d3907a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: df6c7382-2e3c-43bd-b678-327aea25a957] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:09.687894 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-902a242b-e733-4517-a416-24fc10d3907a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:09.688347 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-902a242b-e733-4517-a416-24fc10d3907a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:09.689110 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-902a242b-e733-4517-a416-24fc10d3907a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:09.689548 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-902a242b-e733-4517-a416-24fc10d3907a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:09.817536 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-902a242b-e733-4517-a416-24fc10d3907a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:09.825998 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-902a242b-e733-4517-a416-24fc10d3907a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957" status: 200 len: 1364 microversion: 2.1 time: 0.149953 May 27 15:24:09.826567 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 519/1016] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:09 2022] GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:10.843120 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-06b4004a-f531-46d7-9e4d-74730f73e4cb tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:10.844136 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-06b4004a-f531-46d7-9e4d-74730f73e4cb tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: df6c7382-2e3c-43bd-b678-327aea25a957] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:10.851970 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-06b4004a-f531-46d7-9e4d-74730f73e4cb tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:10.852474 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-06b4004a-f531-46d7-9e4d-74730f73e4cb tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:10.853268 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-06b4004a-f531-46d7-9e4d-74730f73e4cb tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:10.854095 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-06b4004a-f531-46d7-9e4d-74730f73e4cb tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:11.012821 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-06b4004a-f531-46d7-9e4d-74730f73e4cb tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:11.020303 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-06b4004a-f531-46d7-9e4d-74730f73e4cb tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957" status: 200 len: 1364 microversion: 2.1 time: 0.181206 May 27 15:24:11.020967 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 498/1017] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:10 2022] GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:12.037470 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-49188638-eea8-4bd3-83d0-06e80b83cff0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:12.038116 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-49188638-eea8-4bd3-83d0-06e80b83cff0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: df6c7382-2e3c-43bd-b678-327aea25a957] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:12.044892 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-49188638-eea8-4bd3-83d0-06e80b83cff0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:12.045344 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-49188638-eea8-4bd3-83d0-06e80b83cff0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:12.046145 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-49188638-eea8-4bd3-83d0-06e80b83cff0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:12.046579 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-49188638-eea8-4bd3-83d0-06e80b83cff0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:12.174876 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-49188638-eea8-4bd3-83d0-06e80b83cff0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:12.184555 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-49188638-eea8-4bd3-83d0-06e80b83cff0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957" status: 200 len: 1364 microversion: 2.1 time: 0.150960 May 27 15:24:12.185129 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 520/1018] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:12 2022] GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:12.339185 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-90075b24-f8d9-4a9b-9045-a707af3af574 req-00dc6c96-2cec-4230-95dd-473f4625b3e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6c7382-2e3c-43bd-b678-327aea25a957", "name": "network-vif-plugged", "status": "completed", "tag": "d1beeeb3-dbd3-48ae-b2ed-e700b9716741"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:12.348513 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-90075b24-f8d9-4a9b-9045-a707af3af574 req-00dc6c96-2cec-4230-95dd-473f4625b3e5 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:12.348956 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-90075b24-f8d9-4a9b-9045-a707af3af574 req-00dc6c96-2cec-4230-95dd-473f4625b3e5 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:12.361229 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-90075b24-f8d9-4a9b-9045-a707af3af574 req-00dc6c96-2cec-4230-95dd-473f4625b3e5 service nova] Creating event network-vif-plugged:d1beeeb3-dbd3-48ae-b2ed-e700b9716741 for instance df6c7382-2e3c-43bd-b678-327aea25a957 on hv-cinder-84254 May 27 15:24:12.366629 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-90075b24-f8d9-4a9b-9045-a707af3af574 req-00dc6c96-2cec-4230-95dd-473f4625b3e5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032153 May 27 15:24:12.367278 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 499/1019] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:13.201710 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-6ff59c6b-fa2f-4040-937c-1d03a9b9ef17 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:13.202351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-6ff59c6b-fa2f-4040-937c-1d03a9b9ef17 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: df6c7382-2e3c-43bd-b678-327aea25a957] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:13.208943 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6ff59c6b-fa2f-4040-937c-1d03a9b9ef17 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:13.209388 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6ff59c6b-fa2f-4040-937c-1d03a9b9ef17 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:13.210174 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6ff59c6b-fa2f-4040-937c-1d03a9b9ef17 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:13.210642 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6ff59c6b-fa2f-4040-937c-1d03a9b9ef17 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:13.347867 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-6ff59c6b-fa2f-4040-937c-1d03a9b9ef17 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:13.355929 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-6ff59c6b-fa2f-4040-937c-1d03a9b9ef17 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957" status: 200 len: 1364 microversion: 2.1 time: 0.158170 May 27 15:24:13.356515 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 521/1020] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:13 2022] GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:14.373063 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-90055192-6fde-42a1-ad68-a5b0ea0ac99f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:14.373781 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-90055192-6fde-42a1-ad68-a5b0ea0ac99f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: df6c7382-2e3c-43bd-b678-327aea25a957] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:14.376182 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=2 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:14.376832 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=6 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:14.382746 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-90055192-6fde-42a1-ad68-a5b0ea0ac99f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:14.383265 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-90055192-6fde-42a1-ad68-a5b0ea0ac99f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:14.384027 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-90055192-6fde-42a1-ad68-a5b0ea0ac99f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:14.384484 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-90055192-6fde-42a1-ad68-a5b0ea0ac99f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:14.518739 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-90055192-6fde-42a1-ad68-a5b0ea0ac99f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:14.526951 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-90055192-6fde-42a1-ad68-a5b0ea0ac99f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957" status: 200 len: 1553 microversion: 2.1 time: 0.158324 May 27 15:24:14.527517 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 500/1021] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:14 2022] GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:14.543146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-9fa53941-bb10-4b69-9385-b17878bdc6f1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:14.543670 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-9fa53941-bb10-4b69-9385-b17878bdc6f1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: df6c7382-2e3c-43bd-b678-327aea25a957] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:14.545595 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=6 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:14.551668 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9fa53941-bb10-4b69-9385-b17878bdc6f1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:14.552115 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9fa53941-bb10-4b69-9385-b17878bdc6f1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:14.552878 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9fa53941-bb10-4b69-9385-b17878bdc6f1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:14.553313 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9fa53941-bb10-4b69-9385-b17878bdc6f1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:14.628750 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-9fa53941-bb10-4b69-9385-b17878bdc6f1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089608 May 27 15:24:14.629416 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 522/1022] 10.222.0.50 () {58 vars in 1274 bytes} [Fri May 27 15:24:14 2022] GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:15.791444 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-fa70f9a5-4944-4c2c-86dd-9751b28a7ecf req-624e7cda-ea50-4f4c-95cd-1e00ace5d2cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df6c7382-2e3c-43bd-b678-327aea25a957", "tag": "d1beeeb3-dbd3-48ae-b2ed-e700b9716741"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:15.799964 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-fa70f9a5-4944-4c2c-86dd-9751b28a7ecf req-624e7cda-ea50-4f4c-95cd-1e00ace5d2cc service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:15.800514 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-fa70f9a5-4944-4c2c-86dd-9751b28a7ecf req-624e7cda-ea50-4f4c-95cd-1e00ace5d2cc service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:15.811786 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-fa70f9a5-4944-4c2c-86dd-9751b28a7ecf req-624e7cda-ea50-4f4c-95cd-1e00ace5d2cc service nova] Creating event network-changed:d1beeeb3-dbd3-48ae-b2ed-e700b9716741 for instance df6c7382-2e3c-43bd-b678-327aea25a957 on hv-cinder-84254 May 27 15:24:15.817883 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-fa70f9a5-4944-4c2c-86dd-9751b28a7ecf req-624e7cda-ea50-4f4c-95cd-1e00ace5d2cc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030780 May 27 15:24:15.818478 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 501/1023] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:40.934996 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:40.935932 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=34 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:40.940133 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-557e7fa9-aa79-4a23-a4eb-ca67e711435b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:40.940629 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-557e7fa9-aa79-4a23-a4eb-ca67e711435b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 1c7e1edd-4f64-464a-b285-ff67845f9fbd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:40.940888 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-712f2106-baa2-4cba-93cb-6311a11c55b8 req-b7cf8c1d-4af1-44c4-afc4-0f544b3ae3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c7e1edd-4f64-464a-b285-ff67845f9fbd", "tag": "9ba4f6ac-1735-4343-8ad5-506b1f2de62d"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:40.945163 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:40.945815 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:40.953336 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-712f2106-baa2-4cba-93cb-6311a11c55b8 req-b7cf8c1d-4af1-44c4-afc4-0f544b3ae3a4 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:40.953781 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-712f2106-baa2-4cba-93cb-6311a11c55b8 req-b7cf8c1d-4af1-44c4-afc4-0f544b3ae3a4 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:40.961809 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-557e7fa9-aa79-4a23-a4eb-ca67e711435b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:40.962931 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-557e7fa9-aa79-4a23-a4eb-ca67e711435b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:40.963721 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-557e7fa9-aa79-4a23-a4eb-ca67e711435b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:40.964155 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-557e7fa9-aa79-4a23-a4eb-ca67e711435b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:40.967533 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-712f2106-baa2-4cba-93cb-6311a11c55b8 req-b7cf8c1d-4af1-44c4-afc4-0f544b3ae3a4 service nova] Creating event network-changed:9ba4f6ac-1735-4343-8ad5-506b1f2de62d for instance 1c7e1edd-4f64-464a-b285-ff67845f9fbd on hv-cinder-84254 May 27 15:24:40.973615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-712f2106-baa2-4cba-93cb-6311a11c55b8 req-b7cf8c1d-4af1-44c4-afc4-0f544b3ae3a4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037018 May 27 15:24:40.974471 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 502/1024] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:24:40.991267 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-557e7fa9-aa79-4a23-a4eb-ca67e711435b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 1c7e1edd-4f64-464a-b285-ff67845f9fbd] Going to try to terminate instance {{(pid=117742) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:24:41.076330 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-557e7fa9-aa79-4a23-a4eb-ca67e711435b tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd" status: 204 len: 0 microversion: 2.1 time: 0.142225 May 27 15:24:41.077344 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 523/1025] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:24:40 2022] DELETE /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:24:41.086805 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-6b2c1127-acc2-489a-947b-165dfb55ef1c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:41.088339 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-6b2c1127-acc2-489a-947b-165dfb55ef1c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 1c7e1edd-4f64-464a-b285-ff67845f9fbd] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:41.094710 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6b2c1127-acc2-489a-947b-165dfb55ef1c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:41.095472 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6b2c1127-acc2-489a-947b-165dfb55ef1c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:41.096248 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6b2c1127-acc2-489a-947b-165dfb55ef1c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:41.096683 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6b2c1127-acc2-489a-947b-165dfb55ef1c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:41.398052 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-6b2c1127-acc2-489a-947b-165dfb55ef1c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:41.405923 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-6b2c1127-acc2-489a-947b-165dfb55ef1c tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd" status: 200 len: 1576 microversion: 2.1 time: 0.323811 May 27 15:24:41.406592 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 503/1026] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:41 2022] GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd => generated 1576 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:24:42.425668 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-86804cd5-2ebe-4962-bfef-8b0bcff55717 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:42.426419 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-86804cd5-2ebe-4962-bfef-8b0bcff55717 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 1c7e1edd-4f64-464a-b285-ff67845f9fbd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:42.434356 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-86804cd5-2ebe-4962-bfef-8b0bcff55717 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:42.434820 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-86804cd5-2ebe-4962-bfef-8b0bcff55717 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:42.435711 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-86804cd5-2ebe-4962-bfef-8b0bcff55717 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:42.436165 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-86804cd5-2ebe-4962-bfef-8b0bcff55717 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:42.623438 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-86804cd5-2ebe-4962-bfef-8b0bcff55717 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:42.631933 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-86804cd5-2ebe-4962-bfef-8b0bcff55717 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd" status: 200 len: 1576 microversion: 2.1 time: 0.211113 May 27 15:24:42.632558 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 524/1027] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:42 2022] GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd => generated 1576 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:43.559695 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-65c24601-5644-4347-b97d-53f2ebc444b5 req-9566910f-3b45-4b1d-8306-4a783f7b1068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7e1edd-4f64-464a-b285-ff67845f9fbd", "name": "network-vif-deleted", "tag": "9ba4f6ac-1735-4343-8ad5-506b1f2de62d"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:43.568383 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-65c24601-5644-4347-b97d-53f2ebc444b5 req-9566910f-3b45-4b1d-8306-4a783f7b1068 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:43.568822 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-65c24601-5644-4347-b97d-53f2ebc444b5 req-9566910f-3b45-4b1d-8306-4a783f7b1068 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:43.580253 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-65c24601-5644-4347-b97d-53f2ebc444b5 req-9566910f-3b45-4b1d-8306-4a783f7b1068 service nova] Creating event network-vif-deleted:9ba4f6ac-1735-4343-8ad5-506b1f2de62d for instance 1c7e1edd-4f64-464a-b285-ff67845f9fbd on hv-cinder-84254 May 27 15:24:43.584877 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-65c24601-5644-4347-b97d-53f2ebc444b5 req-9566910f-3b45-4b1d-8306-4a783f7b1068 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029137 May 27 15:24:43.585481 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 504/1028] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:43.648633 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e81cf2ed-ed2b-483e-b1c2-e7a5b2fb5a74 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:43.649466 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e81cf2ed-ed2b-483e-b1c2-e7a5b2fb5a74 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 1c7e1edd-4f64-464a-b285-ff67845f9fbd] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:43.658785 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e81cf2ed-ed2b-483e-b1c2-e7a5b2fb5a74 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:43.659270 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e81cf2ed-ed2b-483e-b1c2-e7a5b2fb5a74 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:43.660378 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e81cf2ed-ed2b-483e-b1c2-e7a5b2fb5a74 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:43.660791 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e81cf2ed-ed2b-483e-b1c2-e7a5b2fb5a74 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:43.723642 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-e81cf2ed-ed2b-483e-b1c2-e7a5b2fb5a74 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:43.731318 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-e81cf2ed-ed2b-483e-b1c2-e7a5b2fb5a74 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd" status: 200 len: 1224 microversion: 2.1 time: 0.086578 May 27 15:24:43.731903 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 525/1029] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:43 2022] GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:44.750074 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f06bece9-ae9a-4216-ac52-e1c6ae7553b5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:44.750675 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-f06bece9-ae9a-4216-ac52-e1c6ae7553b5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 1c7e1edd-4f64-464a-b285-ff67845f9fbd] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:44.756859 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f06bece9-ae9a-4216-ac52-e1c6ae7553b5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:44.757306 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f06bece9-ae9a-4216-ac52-e1c6ae7553b5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:44.758058 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f06bece9-ae9a-4216-ac52-e1c6ae7553b5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:44.758487 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f06bece9-ae9a-4216-ac52-e1c6ae7553b5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:44.772313 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-f06bece9-ae9a-4216-ac52-e1c6ae7553b5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] HTTP exception thrown: Instance 1c7e1edd-4f64-464a-b285-ff67845f9fbd could not be found. May 27 15:24:44.773939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f06bece9-ae9a-4216-ac52-e1c6ae7553b5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Request method failure captured: May 27 15:24:44.773939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd HTTP/1.1 May 27 15:24:44.773939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:24:44.773939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:24:44.773939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:24:44.773939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 0 May 27 15:24:44.773939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:24:44.773939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:24:44.773939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:24:44.773939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:24:44.773939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOtKZtXzbtQq-mzRl_VucDX3JU2QZa0XFpKq1w0KZsmc8vHDP47vFW9o-cpdTV2XgVEmnZ2ELAeJmUo9SgWsSCNtvd2INJL0jeoi_VloSf945zMe90YQAg2IKM9mZrXPdblMPFwj-yqV843Kd81q3M0zyP0qopiCS0_yG3grfqi5ohU May 27 15:24:44.773939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:24:44.773939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:24:44.773939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:24:44.773939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:24:44.773939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:24:44.773939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:24:44.773939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: f88bb4c8b75c4ad6be62f2cf5cf509c4 May 27 15:24:44.773939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-TestVolumeBootPattern-1063732983 May 27 15:24:44.773939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:24:44.773939 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:24:44.776296 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f88bb4c8b75c4ad6be62f2cf5cf509c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f88bb4c8b75c4ad6be62f2cf5cf509c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f88bb4c8b75c4ad6be62f2cf5cf509c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f88bb4c8b75c4ad6be62f2cf5cf509c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:24:44.776296 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-TestVolumeBootPattern-1063732983 May 27 15:24:44.776296 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: f88bb4c8b75c4ad6be62f2cf5cf509c4 May 27 15:24:44.776296 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-TestVolumeBootPattern-1063732983 May 27 15:24:44.776296 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-TestVolumeBootPattern-1063732983-project May 27 15:24:44.776296 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:24:44.776296 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:24:44.776296 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: af74115f423c43fdb2544876be4e5622 May 27 15:24:44.776296 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-TestVolumeBootPattern-1063732983-project May 27 15:24:44.776296 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: > May 27 15:24:44.776296 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Instance 1c7e1edd-4f64-464a-b285-ff67845f9fbd could not be found. May 27 15:24:44.776296 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'id': '1c7e1edd-4f64-464a-b285-ff67845f9fbd'} May 27 15:24:44.777158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:44.777158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:44.777158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:24:44.777158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:24:44.777158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:24:44.777158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:24:44.777158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:24:44.777158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:24:44.777158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:24:44.777158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:24:44.777158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c7e1edd-4f64-464a-b285-ff67845f9fbd could not be found. May 27 15:24:44.777158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:24:44.777158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:44.777158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:24:44.777158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:44.777158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:44.777158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:44.777158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:44.777158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:44.777158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:44.778838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:44.778838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:24:44.778838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:24:44.778838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:24:44.778838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:24:44.778838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:24:44.778838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:24:44.778838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c7e1edd-4f64-464a-b285-ff67845f9fbd could not be found. May 27 15:24:44.778838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:24:44.778838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:44.778838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:24:44.778838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:44.778838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:44.778838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:44.778838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:44.778838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:44.778838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c7e1edd-4f64-464a-b285-ff67845f9fbd could not be found. May 27 15:24:44.778838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:24:44.780671 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f06bece9-ae9a-4216-ac52-e1c6ae7553b5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Returning 404 to user: Instance 1c7e1edd-4f64-464a-b285-ff67845f9fbd could not be found. {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:44.780671 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-f06bece9-ae9a-4216-ac52-e1c6ae7553b5 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd" status: 404 len: 111 microversion: 2.1 time: 0.030712 May 27 15:24:44.780671 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 505/1030] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:44 2022] GET /compute/v2.1/servers/1c7e1edd-4f64-464a-b285-ff67845f9fbd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:24:47.886570 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-7eb6e6f5-814f-428b-ae20-6ac0d9081ce8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:47.887540 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-8c59cceb-931a-4434-a3af-ffe235cdfbb5 req-d3ee49e8-eb38-491d-a817-09f71c1a0547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57293bbe-cb31-4f35-b133-3b8e673465cb", "tag": "9612e155-cd8f-4e21-816c-b8322b4a154e"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:47.888292 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-7eb6e6f5-814f-428b-ae20-6ac0d9081ce8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:47.898691 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7eb6e6f5-814f-428b-ae20-6ac0d9081ce8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:47.900281 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7eb6e6f5-814f-428b-ae20-6ac0d9081ce8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:47.902435 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7eb6e6f5-814f-428b-ae20-6ac0d9081ce8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:47.902570 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-8c59cceb-931a-4434-a3af-ffe235cdfbb5 req-d3ee49e8-eb38-491d-a817-09f71c1a0547 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:47.903236 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-7eb6e6f5-814f-428b-ae20-6ac0d9081ce8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:47.903450 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-8c59cceb-931a-4434-a3af-ffe235cdfbb5 req-d3ee49e8-eb38-491d-a817-09f71c1a0547 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:47.924773 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-8c59cceb-931a-4434-a3af-ffe235cdfbb5 req-d3ee49e8-eb38-491d-a817-09f71c1a0547 service nova] Creating event network-changed:9612e155-cd8f-4e21-816c-b8322b4a154e for instance 57293bbe-cb31-4f35-b133-3b8e673465cb on hv-cinder-84254 May 27 15:24:47.932797 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-8c59cceb-931a-4434-a3af-ffe235cdfbb5 req-d3ee49e8-eb38-491d-a817-09f71c1a0547 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051928 May 27 15:24:47.934143 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 506/1031] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:47.945216 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-7eb6e6f5-814f-428b-ae20-6ac0d9081ce8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Going to try to terminate instance {{(pid=117742) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:24:48.049312 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-7eb6e6f5-814f-428b-ae20-6ac0d9081ce8 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "DELETE /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 204 len: 0 microversion: 2.1 time: 0.170511 May 27 15:24:48.054598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 526/1032] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:24:47 2022] DELETE /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:24:48.061557 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b621562d-d324-43c1-923a-9d2d0064bd4e tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:48.062414 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b621562d-d324-43c1-923a-9d2d0064bd4e tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:48.069496 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b621562d-d324-43c1-923a-9d2d0064bd4e tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:48.070224 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b621562d-d324-43c1-923a-9d2d0064bd4e tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:48.071386 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b621562d-d324-43c1-923a-9d2d0064bd4e tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:48.072621 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b621562d-d324-43c1-923a-9d2d0064bd4e tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:48.220571 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b621562d-d324-43c1-923a-9d2d0064bd4e tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:48.235063 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b621562d-d324-43c1-923a-9d2d0064bd4e tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1577 microversion: 2.1 time: 0.177964 May 27 15:24:48.236109 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 507/1033] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:48 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1577 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:49.262096 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-1e72adfc-6b7a-4421-92a4-968d7be12fa0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:49.262913 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-1e72adfc-6b7a-4421-92a4-968d7be12fa0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:49.269361 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1e72adfc-6b7a-4421-92a4-968d7be12fa0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:49.269811 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1e72adfc-6b7a-4421-92a4-968d7be12fa0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:49.270570 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1e72adfc-6b7a-4421-92a4-968d7be12fa0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:49.271041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1e72adfc-6b7a-4421-92a4-968d7be12fa0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:49.409977 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-1e72adfc-6b7a-4421-92a4-968d7be12fa0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:49.417974 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-1e72adfc-6b7a-4421-92a4-968d7be12fa0 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1577 microversion: 2.1 time: 0.160691 May 27 15:24:49.418551 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 527/1034] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:49 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:50.435431 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-380bfa3a-c33e-46b9-88fd-73b291757b25 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:50.436046 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-380bfa3a-c33e-46b9-88fd-73b291757b25 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:50.442586 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-380bfa3a-c33e-46b9-88fd-73b291757b25 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:50.443090 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-380bfa3a-c33e-46b9-88fd-73b291757b25 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:50.443869 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-380bfa3a-c33e-46b9-88fd-73b291757b25 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:50.444359 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-380bfa3a-c33e-46b9-88fd-73b291757b25 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:50.517647 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-380bfa3a-c33e-46b9-88fd-73b291757b25 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:50.526045 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-380bfa3a-c33e-46b9-88fd-73b291757b25 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1391 microversion: 2.1 time: 0.094477 May 27 15:24:50.526631 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 508/1035] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:50 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1391 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:50.541923 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-c15edb4e-c230-470d-b58b-f24755d57d50 req-14e95e6e-b739-499d-93a3-3b1035c03d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57293bbe-cb31-4f35-b133-3b8e673465cb", "name": "network-vif-deleted", "tag": "9612e155-cd8f-4e21-816c-b8322b4a154e"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:50.550442 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-c15edb4e-c230-470d-b58b-f24755d57d50 req-14e95e6e-b739-499d-93a3-3b1035c03d74 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:50.550910 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-c15edb4e-c230-470d-b58b-f24755d57d50 req-14e95e6e-b739-499d-93a3-3b1035c03d74 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:50.561808 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-c15edb4e-c230-470d-b58b-f24755d57d50 req-14e95e6e-b739-499d-93a3-3b1035c03d74 service nova] Creating event network-vif-deleted:9612e155-cd8f-4e21-816c-b8322b4a154e for instance 57293bbe-cb31-4f35-b133-3b8e673465cb on hv-cinder-84254 May 27 15:24:50.566393 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-c15edb4e-c230-470d-b58b-f24755d57d50 req-14e95e6e-b739-499d-93a3-3b1035c03d74 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028627 May 27 15:24:50.567014 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 528/1036] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:51.544103 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b86b344d-0e67-42c2-b729-2f4a7a150103 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:51.544760 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b86b344d-0e67-42c2-b729-2f4a7a150103 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:51.551625 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b86b344d-0e67-42c2-b729-2f4a7a150103 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:51.552142 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b86b344d-0e67-42c2-b729-2f4a7a150103 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:51.552915 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b86b344d-0e67-42c2-b729-2f4a7a150103 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:51.553349 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b86b344d-0e67-42c2-b729-2f4a7a150103 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:51.583612 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b86b344d-0e67-42c2-b729-2f4a7a150103 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:51.584062 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b86b344d-0e67-42c2-b729-2f4a7a150103 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:51.584503 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.objects.instance [None req-b86b344d-0e67-42c2-b729-2f4a7a150103 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lazy-loading 'fault' on Instance uuid 57293bbe-cb31-4f35-b133-3b8e673465cb {{(pid=117743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:24:51.626661 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b86b344d-0e67-42c2-b729-2f4a7a150103 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af74115f423c43fdb2544876be4e5622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f88bb4c8b75c4ad6be62f2cf5cf509c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:51.634094 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b86b344d-0e67-42c2-b729-2f4a7a150103 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 200 len: 1230 microversion: 2.1 time: 0.094513 May 27 15:24:51.634665 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 509/1037] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:51 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:51.930515 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-45744666-6466-4a57-90bb-d967916eea2d tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:51.931123 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-45744666-6466-4a57-90bb-d967916eea2d tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: df6c7382-2e3c-43bd-b678-327aea25a957] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:51.937408 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-45744666-6466-4a57-90bb-d967916eea2d tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:51.937895 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-45744666-6466-4a57-90bb-d967916eea2d tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:51.938658 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-45744666-6466-4a57-90bb-d967916eea2d tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:51.939118 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-45744666-6466-4a57-90bb-d967916eea2d tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:51.962768 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-45744666-6466-4a57-90bb-d967916eea2d tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957/ips" status: 200 len: 149 microversion: 2.1 time: 0.036517 May 27 15:24:51.963514 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 529/1038] 10.222.0.50 () {58 vars in 1247 bytes} [Fri May 27 15:24:51 2022] GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:51.975004 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-86041359-9b0d-4f6c-ba68-87b083c7fab7 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a63f5c00-1d56-41b9-9327-b3563b987ff0"}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:51.976114 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-86041359-9b0d-4f6c-ba68-87b083c7fab7 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: df6c7382-2e3c-43bd-b678-327aea25a957] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:51.982073 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-86041359-9b0d-4f6c-ba68-87b083c7fab7 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:51.982513 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-86041359-9b0d-4f6c-ba68-87b083c7fab7 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:51.983308 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-86041359-9b0d-4f6c-ba68-87b083c7fab7 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:51.983741 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-86041359-9b0d-4f6c-ba68-87b083c7fab7 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:52.064342 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-86041359-9b0d-4f6c-ba68-87b083c7fab7 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] HTTP exception thrown: Invalid volume: volume a63f5c00-1d56-41b9-9327-b3563b987ff0 is already attached to instances: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e May 27 15:24:52.066084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-86041359-9b0d-4f6c-ba68-87b083c7fab7 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Request method failure captured: May 27 15:24:52.066084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: POST /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957/os-volume_attachments HTTP/1.1 May 27 15:24:52.066084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:24:52.066084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:24:52.066084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:24:52.066084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 74 May 27 15:24:52.066084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:24:52.066084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:24:52.066084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:24:52.066084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:24:52.066084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOzNSb8dAVARh41NDH1neBeIQ7mEiYGzluZ1aLHWr-bZMM8Yk3DEMls-W331t4g56BKuQBAiw5JIF3Yut9sBSPvmBYrZo49s8qFM14ylIEBI_1nGqB4zBnvHBSyTSPec4EhH5fjot66Y9DnhxIGyrqIMzSWHLKve581Z3mM8_f45p1g May 27 15:24:52.066084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:24:52.066084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:24:52.066084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:24:52.066084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:24:52.066084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:24:52.066084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:24:52.066084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:24:52.066084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:24:52.066084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:24:52.066084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:24:52.067757 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f027c3b75bc6430abd765a26269f9058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:24:52.067757 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:24:52.067757 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:24:52.067757 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:24:52.067757 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:24:52.067757 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:24:52.067757 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:24:52.067757 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: b1302d3b8649407ca010f12aad7a6597 May 27 15:24:52.067757 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:24:52.067757 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: May 27 15:24:52.067757 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {"volumeAttachment": {"volumeId": "a63f5c00-1d56-41b9-9327-b3563b987ff0"}} May 27 15:24:52.067757 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: > May 27 15:24:52.068758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Invalid volume: volume a63f5c00-1d56-41b9-9327-b3563b987ff0 is already attached to instances: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e May 27 15:24:52.068758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'server_id': 'df6c7382-2e3c-43bd-b678-327aea25a957', 'body': {'volumeAttachment': {'volumeId': 'a63f5c00-1d56-41b9-9327-b3563b987ff0'}}} May 27 15:24:52.068758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:52.068758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:52.068758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 15:24:52.068758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 15:24:52.068758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:24:52.068758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:24:52.068758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 27 15:24:52.068758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 15:24:52.068758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 27 15:24:52.068758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 27 15:24:52.068758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 27 15:24:52.068758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 27 15:24:52.068758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a63f5c00-1d56-41b9-9327-b3563b987ff0 is already attached to instances: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e May 27 15:24:52.068758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:24:52.068758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:52.068758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:24:52.068758 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:52.070305 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:52.070305 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:52.070305 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:52.070305 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:52.070305 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:52.070305 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:52.070305 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:52.070305 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:52.070305 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:52.070305 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:52.070305 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:24:52.070305 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:24:52.070305 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 27 15:24:52.070305 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 27 15:24:52.070305 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a63f5c00-1d56-41b9-9327-b3563b987ff0 is already attached to instances: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e May 27 15:24:52.070305 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:24:52.070305 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:52.070305 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:24:52.070305 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:52.070305 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:52.072520 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:52.072520 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:52.072520 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:52.072520 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a63f5c00-1d56-41b9-9327-b3563b987ff0 is already attached to instances: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e May 27 15:24:52.072520 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:24:52.072520 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-86041359-9b0d-4f6c-ba68-87b083c7fab7 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Returning 400 to user: Invalid volume: volume a63f5c00-1d56-41b9-9327-b3563b987ff0 is already attached to instances: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:52.072520 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-86041359-9b0d-4f6c-ba68-87b083c7fab7 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "POST /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096588 May 27 15:24:52.072520 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 510/1039] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 15:24:51 2022] POST /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:24:52.077719 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-60e93efb-aec6-4bb6-bc84-04a0df639943 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:52.078237 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-60e93efb-aec6-4bb6-bc84-04a0df639943 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: df6c7382-2e3c-43bd-b678-327aea25a957] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:52.084417 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-60e93efb-aec6-4bb6-bc84-04a0df639943 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:52.084870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-60e93efb-aec6-4bb6-bc84-04a0df639943 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:52.085645 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-60e93efb-aec6-4bb6-bc84-04a0df639943 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:52.086067 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-60e93efb-aec6-4bb6-bc84-04a0df639943 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:52.111552 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-60e93efb-aec6-4bb6-bc84-04a0df639943 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: df6c7382-2e3c-43bd-b678-327aea25a957] Going to try to terminate instance {{(pid=117742) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:24:52.185782 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-60e93efb-aec6-4bb6-bc84-04a0df639943 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "DELETE /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957" status: 204 len: 0 microversion: 2.1 time: 0.111693 May 27 15:24:52.186285 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 530/1040] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:24:52 2022] DELETE /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:24:52.198722 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-f1d40711-9ab3-4895-a25f-8da08086a105 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:52.199873 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-f1d40711-9ab3-4895-a25f-8da08086a105 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: df6c7382-2e3c-43bd-b678-327aea25a957] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:52.208878 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f1d40711-9ab3-4895-a25f-8da08086a105 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:52.209333 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f1d40711-9ab3-4895-a25f-8da08086a105 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:52.210113 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f1d40711-9ab3-4895-a25f-8da08086a105 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:52.210549 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-f1d40711-9ab3-4895-a25f-8da08086a105 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:52.347401 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-f1d40711-9ab3-4895-a25f-8da08086a105 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:52.354973 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-f1d40711-9ab3-4895-a25f-8da08086a105 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957" status: 200 len: 1678 microversion: 2.1 time: 0.163122 May 27 15:24:52.355538 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 511/1041] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:52 2022] GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:52.651929 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-95f12ee9-c739-49b2-98b2-c55274e00183 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:52.652627 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-95f12ee9-c739-49b2-98b2-c55274e00183 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 57293bbe-cb31-4f35-b133-3b8e673465cb] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:52.658646 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-95f12ee9-c739-49b2-98b2-c55274e00183 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:52.659122 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-95f12ee9-c739-49b2-98b2-c55274e00183 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:52.659882 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-95f12ee9-c739-49b2-98b2-c55274e00183 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:52.660317 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-95f12ee9-c739-49b2-98b2-c55274e00183 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:52.676328 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-95f12ee9-c739-49b2-98b2-c55274e00183 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] HTTP exception thrown: Instance 57293bbe-cb31-4f35-b133-3b8e673465cb could not be found. May 27 15:24:52.677920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-95f12ee9-c739-49b2-98b2-c55274e00183 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Request method failure captured: May 27 15:24:52.677920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb HTTP/1.1 May 27 15:24:52.677920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:24:52.677920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:24:52.677920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:24:52.677920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:24:52.677920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:24:52.677920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:24:52.677920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:24:52.677920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:24:52.677920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOtKZtXzbtQq-mzRl_VucDX3JU2QZa0XFpKq1w0KZsmc8vHDP47vFW9o-cpdTV2XgVEmnZ2ELAeJmUo9SgWsSCNtvd2INJL0jeoi_VloSf945zMe90YQAg2IKM9mZrXPdblMPFwj-yqV843Kd81q3M0zyP0qopiCS0_yG3grfqi5ohU May 27 15:24:52.677920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:24:52.677920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:24:52.677920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:24:52.677920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:24:52.677920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:24:52.677920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:24:52.677920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: f88bb4c8b75c4ad6be62f2cf5cf509c4 May 27 15:24:52.677920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-TestVolumeBootPattern-1063732983 May 27 15:24:52.677920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:24:52.677920 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:24:52.679541 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f88bb4c8b75c4ad6be62f2cf5cf509c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f88bb4c8b75c4ad6be62f2cf5cf509c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f88bb4c8b75c4ad6be62f2cf5cf509c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f88bb4c8b75c4ad6be62f2cf5cf509c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:24:52.679541 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-TestVolumeBootPattern-1063732983 May 27 15:24:52.679541 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: f88bb4c8b75c4ad6be62f2cf5cf509c4 May 27 15:24:52.679541 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-TestVolumeBootPattern-1063732983 May 27 15:24:52.679541 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-TestVolumeBootPattern-1063732983-project May 27 15:24:52.679541 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:24:52.679541 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:24:52.679541 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: af74115f423c43fdb2544876be4e5622 May 27 15:24:52.679541 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-TestVolumeBootPattern-1063732983-project May 27 15:24:52.679541 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:24:52.679541 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance 57293bbe-cb31-4f35-b133-3b8e673465cb could not be found. May 27 15:24:52.679541 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': '57293bbe-cb31-4f35-b133-3b8e673465cb'} May 27 15:24:52.680456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:52.680456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:52.680456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:24:52.680456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:24:52.680456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:24:52.680456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:24:52.680456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:24:52.680456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:24:52.680456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:24:52.680456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:24:52.680456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57293bbe-cb31-4f35-b133-3b8e673465cb could not be found. May 27 15:24:52.680456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:24:52.680456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:52.680456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:24:52.680456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:52.680456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:52.680456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:52.680456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:52.680456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:52.680456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:52.682717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:52.682717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:24:52.682717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:24:52.682717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:24:52.682717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:24:52.682717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:24:52.682717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:24:52.682717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57293bbe-cb31-4f35-b133-3b8e673465cb could not be found. May 27 15:24:52.682717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:24:52.682717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:52.682717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:24:52.682717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:52.682717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:52.682717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:52.682717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:52.682717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:52.682717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57293bbe-cb31-4f35-b133-3b8e673465cb could not be found. May 27 15:24:52.682717 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:24:52.684273 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-95f12ee9-c739-49b2-98b2-c55274e00183 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Returning 404 to user: Instance 57293bbe-cb31-4f35-b133-3b8e673465cb could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:52.684273 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-95f12ee9-c739-49b2-98b2-c55274e00183 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb" status: 404 len: 111 microversion: 2.1 time: 0.031858 May 27 15:24:52.684273 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 531/1042] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:52 2022] GET /compute/v2.1/servers/57293bbe-cb31-4f35-b133-3b8e673465cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:24:53.115282 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-df3d4ae9-d462-43ae-8370-f5eb74333009 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:53.115842 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-df3d4ae9-d462-43ae-8370-f5eb74333009 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:53.123799 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-df3d4ae9-d462-43ae-8370-f5eb74333009 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:53.124243 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-df3d4ae9-d462-43ae-8370-f5eb74333009 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:53.125025 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-df3d4ae9-d462-43ae-8370-f5eb74333009 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:53.125461 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-df3d4ae9-d462-43ae-8370-f5eb74333009 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:53.141167 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-df3d4ae9-d462-43ae-8370-f5eb74333009 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] HTTP exception thrown: Instance 0b00f36f-8f62-43f7-bdeb-71c22904dd0a could not be found. May 27 15:24:53.142756 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-df3d4ae9-d462-43ae-8370-f5eb74333009 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Request method failure captured: May 27 15:24:53.142756 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: DELETE /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a HTTP/1.1 May 27 15:24:53.142756 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:24:53.142756 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:24:53.142756 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:24:53.142756 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 0 May 27 15:24:53.142756 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:24:53.142756 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:24:53.142756 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:24:53.142756 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:24:53.142756 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOtKZtXzbtQq-mzRl_VucDX3JU2QZa0XFpKq1w0KZsmc8vHDP47vFW9o-cpdTV2XgVEmnZ2ELAeJmUo9SgWsSCNtvd2INJL0jeoi_VloSf945zMe90YQAg2IKM9mZrXPdblMPFwj-yqV843Kd81q3M0zyP0qopiCS0_yG3grfqi5ohU May 27 15:24:53.142756 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:24:53.142756 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:24:53.142756 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:24:53.142756 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:24:53.142756 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:24:53.142756 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:24:53.142756 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: f88bb4c8b75c4ad6be62f2cf5cf509c4 May 27 15:24:53.142756 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-TestVolumeBootPattern-1063732983 May 27 15:24:53.142756 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:24:53.142756 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:24:53.144391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f88bb4c8b75c4ad6be62f2cf5cf509c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f88bb4c8b75c4ad6be62f2cf5cf509c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f88bb4c8b75c4ad6be62f2cf5cf509c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f88bb4c8b75c4ad6be62f2cf5cf509c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:24:53.144391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-TestVolumeBootPattern-1063732983 May 27 15:24:53.144391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: f88bb4c8b75c4ad6be62f2cf5cf509c4 May 27 15:24:53.144391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-TestVolumeBootPattern-1063732983 May 27 15:24:53.144391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-TestVolumeBootPattern-1063732983-project May 27 15:24:53.144391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:24:53.144391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:24:53.144391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: af74115f423c43fdb2544876be4e5622 May 27 15:24:53.144391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-TestVolumeBootPattern-1063732983-project May 27 15:24:53.144391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: > May 27 15:24:53.144391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Instance 0b00f36f-8f62-43f7-bdeb-71c22904dd0a could not be found. May 27 15:24:53.144391 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'id': '0b00f36f-8f62-43f7-bdeb-71c22904dd0a'} May 27 15:24:53.145299 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:53.145299 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:53.145299 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:24:53.145299 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:24:53.145299 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:24:53.145299 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:24:53.145299 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:24:53.145299 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:24:53.145299 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:24:53.145299 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:24:53.145299 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b00f36f-8f62-43f7-bdeb-71c22904dd0a could not be found. May 27 15:24:53.145299 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:24:53.145299 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:53.145299 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:24:53.145299 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:53.145299 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:53.145299 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:53.145299 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:53.145299 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:53.145299 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:53.146980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:53.146980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:24:53.146980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:24:53.146980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:24:53.146980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:24:53.146980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:24:53.146980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:24:53.146980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:24:53.146980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:24:53.146980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b00f36f-8f62-43f7-bdeb-71c22904dd0a could not be found. May 27 15:24:53.146980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:24:53.146980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:53.146980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:24:53.146980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:53.146980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:53.146980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:53.146980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:53.146980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:53.146980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b00f36f-8f62-43f7-bdeb-71c22904dd0a could not be found. May 27 15:24:53.146980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:24:53.148626 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-df3d4ae9-d462-43ae-8370-f5eb74333009 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Returning 404 to user: Instance 0b00f36f-8f62-43f7-bdeb-71c22904dd0a could not be found. {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:53.148626 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-df3d4ae9-d462-43ae-8370-f5eb74333009 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 404 len: 111 microversion: 2.1 time: 0.032834 May 27 15:24:53.148626 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 512/1043] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:24:53 2022] DELETE /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:24:53.153496 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-6f8e5e7e-13b7-43d7-919e-d6e45adc1918 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:53.154215 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-6f8e5e7e-13b7-43d7-919e-d6e45adc1918 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] [instance: 0b00f36f-8f62-43f7-bdeb-71c22904dd0a] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:53.161464 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6f8e5e7e-13b7-43d7-919e-d6e45adc1918 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:53.161927 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6f8e5e7e-13b7-43d7-919e-d6e45adc1918 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:53.162713 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6f8e5e7e-13b7-43d7-919e-d6e45adc1918 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:53.163208 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-6f8e5e7e-13b7-43d7-919e-d6e45adc1918 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:53.178446 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-6f8e5e7e-13b7-43d7-919e-d6e45adc1918 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] HTTP exception thrown: Instance 0b00f36f-8f62-43f7-bdeb-71c22904dd0a could not be found. May 27 15:24:53.180146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-6f8e5e7e-13b7-43d7-919e-d6e45adc1918 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Request method failure captured: May 27 15:24:53.180146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a HTTP/1.1 May 27 15:24:53.180146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:24:53.180146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:24:53.180146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:24:53.180146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:24:53.180146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:24:53.180146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:24:53.180146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:24:53.180146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:24:53.180146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOtKZtXzbtQq-mzRl_VucDX3JU2QZa0XFpKq1w0KZsmc8vHDP47vFW9o-cpdTV2XgVEmnZ2ELAeJmUo9SgWsSCNtvd2INJL0jeoi_VloSf945zMe90YQAg2IKM9mZrXPdblMPFwj-yqV843Kd81q3M0zyP0qopiCS0_yG3grfqi5ohU May 27 15:24:53.180146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:24:53.180146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:24:53.180146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:24:53.180146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:24:53.180146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:24:53.180146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:24:53.180146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: f88bb4c8b75c4ad6be62f2cf5cf509c4 May 27 15:24:53.180146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-TestVolumeBootPattern-1063732983 May 27 15:24:53.180146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:24:53.180146 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:24:53.182381 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f88bb4c8b75c4ad6be62f2cf5cf509c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f88bb4c8b75c4ad6be62f2cf5cf509c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f88bb4c8b75c4ad6be62f2cf5cf509c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f88bb4c8b75c4ad6be62f2cf5cf509c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:24:53.182381 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-TestVolumeBootPattern-1063732983 May 27 15:24:53.182381 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: f88bb4c8b75c4ad6be62f2cf5cf509c4 May 27 15:24:53.182381 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-TestVolumeBootPattern-1063732983 May 27 15:24:53.182381 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-TestVolumeBootPattern-1063732983-project May 27 15:24:53.182381 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:24:53.182381 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:24:53.182381 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: af74115f423c43fdb2544876be4e5622 May 27 15:24:53.182381 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-TestVolumeBootPattern-1063732983-project May 27 15:24:53.182381 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:24:53.182381 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance 0b00f36f-8f62-43f7-bdeb-71c22904dd0a could not be found. May 27 15:24:53.182381 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': '0b00f36f-8f62-43f7-bdeb-71c22904dd0a'} May 27 15:24:53.183332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:53.183332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:53.183332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:24:53.183332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:24:53.183332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:24:53.183332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:24:53.183332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:24:53.183332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:24:53.183332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:24:53.183332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:24:53.183332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b00f36f-8f62-43f7-bdeb-71c22904dd0a could not be found. May 27 15:24:53.183332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:24:53.183332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:53.183332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:24:53.183332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:53.183332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:53.183332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:53.183332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:53.183332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:53.183332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:53.184898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:53.184898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:24:53.184898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:24:53.184898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:24:53.184898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:24:53.184898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:24:53.184898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:24:53.184898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b00f36f-8f62-43f7-bdeb-71c22904dd0a could not be found. May 27 15:24:53.184898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:24:53.184898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:53.184898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:24:53.184898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:53.184898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:53.184898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:53.184898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:53.184898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:53.184898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b00f36f-8f62-43f7-bdeb-71c22904dd0a could not be found. May 27 15:24:53.184898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:24:53.186191 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-6f8e5e7e-13b7-43d7-919e-d6e45adc1918 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Returning 404 to user: Instance 0b00f36f-8f62-43f7-bdeb-71c22904dd0a could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:53.186191 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-6f8e5e7e-13b7-43d7-919e-d6e45adc1918 tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a" status: 404 len: 111 microversion: 2.1 time: 0.034553 May 27 15:24:53.186191 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 532/1044] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:53 2022] GET /compute/v2.1/servers/0b00f36f-8f62-43f7-bdeb-71c22904dd0a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:24:53.373048 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-0c4f881f-e024-4030-86ae-cd6a78c2e169 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:53.373598 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-0c4f881f-e024-4030-86ae-cd6a78c2e169 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: df6c7382-2e3c-43bd-b678-327aea25a957] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:53.379645 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0c4f881f-e024-4030-86ae-cd6a78c2e169 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:53.380098 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0c4f881f-e024-4030-86ae-cd6a78c2e169 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:53.380863 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0c4f881f-e024-4030-86ae-cd6a78c2e169 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:53.381303 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0c4f881f-e024-4030-86ae-cd6a78c2e169 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:53.515264 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-0c4f881f-e024-4030-86ae-cd6a78c2e169 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:53.522658 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-0c4f881f-e024-4030-86ae-cd6a78c2e169 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957" status: 200 len: 1678 microversion: 2.1 time: 0.154389 May 27 15:24:53.523250 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 513/1045] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:53 2022] GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:54.495049 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-fca1ba01-94a2-4f26-9255-9eacfaaf340a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] Calling method '.version_select at 0x7f57e18b6160>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:54.525004 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-fca1ba01-94a2-4f26-9255-9eacfaaf340a tempest-TestVolumeBootPattern-1063732983 tempest-TestVolumeBootPattern-1063732983-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-504926628" status: 202 len: 0 microversion: 2.1 time: 0.033705 May 27 15:24:54.529061 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 533/1046] 10.222.0.50 () {58 vars in 1259 bytes} [Fri May 27 15:24:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-504926628 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:24:54.540684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-92c15d49-8761-46b3-acc4-bff11ac6a806 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:54.541786 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-92c15d49-8761-46b3-acc4-bff11ac6a806 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: df6c7382-2e3c-43bd-b678-327aea25a957] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:54.548725 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-92c15d49-8761-46b3-acc4-bff11ac6a806 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:54.549451 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-92c15d49-8761-46b3-acc4-bff11ac6a806 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:54.550464 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-92c15d49-8761-46b3-acc4-bff11ac6a806 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:54.551116 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-92c15d49-8761-46b3-acc4-bff11ac6a806 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:54.732374 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-92c15d49-8761-46b3-acc4-bff11ac6a806 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:54.740814 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-92c15d49-8761-46b3-acc4-bff11ac6a806 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957" status: 200 len: 1678 microversion: 2.1 time: 0.204585 May 27 15:24:54.741561 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 514/1047] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:54 2022] GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957 => generated 1678 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:54.984442 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-2e17cb4d-8f74-4963-8a67-6e12c374e6f2 req-f13ed694-b762-4b62-a761-934debcda57d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6c7382-2e3c-43bd-b678-327aea25a957", "name": "network-vif-deleted", "tag": "d1beeeb3-dbd3-48ae-b2ed-e700b9716741"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:24:54.998194 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-2e17cb4d-8f74-4963-8a67-6e12c374e6f2 req-f13ed694-b762-4b62-a761-934debcda57d service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:55.004665 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-2e17cb4d-8f74-4963-8a67-6e12c374e6f2 req-f13ed694-b762-4b62-a761-934debcda57d service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:55.028932 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-2e17cb4d-8f74-4963-8a67-6e12c374e6f2 req-f13ed694-b762-4b62-a761-934debcda57d service nova] Creating event network-vif-deleted:d1beeeb3-dbd3-48ae-b2ed-e700b9716741 for instance df6c7382-2e3c-43bd-b678-327aea25a957 on hv-cinder-84254 May 27 15:24:55.037765 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-2e17cb4d-8f74-4963-8a67-6e12c374e6f2 req-f13ed694-b762-4b62-a761-934debcda57d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056855 May 27 15:24:55.039092 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 534/1048] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:24:55.762748 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-bdf41044-4c0e-4dbd-b38e-ad013cc64af0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:55.764216 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-bdf41044-4c0e-4dbd-b38e-ad013cc64af0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: df6c7382-2e3c-43bd-b678-327aea25a957] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:55.771698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bdf41044-4c0e-4dbd-b38e-ad013cc64af0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:55.772459 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bdf41044-4c0e-4dbd-b38e-ad013cc64af0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:55.773416 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bdf41044-4c0e-4dbd-b38e-ad013cc64af0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:55.774036 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-bdf41044-4c0e-4dbd-b38e-ad013cc64af0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:55.792797 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-bdf41044-4c0e-4dbd-b38e-ad013cc64af0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] HTTP exception thrown: Instance df6c7382-2e3c-43bd-b678-327aea25a957 could not be found. May 27 15:24:55.794694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-bdf41044-4c0e-4dbd-b38e-ad013cc64af0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Request method failure captured: May 27 15:24:55.794694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957 HTTP/1.1 May 27 15:24:55.794694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:24:55.794694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:24:55.794694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:24:55.794694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 0 May 27 15:24:55.794694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:24:55.794694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:24:55.794694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:24:55.794694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:24:55.794694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOzNSb8dAVARh41NDH1neBeIQ7mEiYGzluZ1aLHWr-bZMM8Yk3DEMls-W331t4g56BKuQBAiw5JIF3Yut9sBSPvmBYrZo49s8qFM14ylIEBI_1nGqB4zBnvHBSyTSPec4EhH5fjot66Y9DnhxIGyrqIMzSWHLKve581Z3mM8_f45p1g May 27 15:24:55.794694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:24:55.794694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:24:55.794694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:24:55.794694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:24:55.794694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:24:55.794694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:24:55.794694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:24:55.794694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:24:55.794694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:24:55.794694 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:24:55.796373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f027c3b75bc6430abd765a26269f9058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:24:55.796373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:24:55.796373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:24:55.796373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:24:55.796373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:24:55.796373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:24:55.796373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:24:55.796373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: b1302d3b8649407ca010f12aad7a6597 May 27 15:24:55.796373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:24:55.796373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: > May 27 15:24:55.796373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Instance df6c7382-2e3c-43bd-b678-327aea25a957 could not be found. May 27 15:24:55.796373 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'id': 'df6c7382-2e3c-43bd-b678-327aea25a957'} May 27 15:24:55.797281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:24:55.797281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:55.797281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:24:55.797281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:24:55.797281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:24:55.797281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:24:55.797281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:24:55.797281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:24:55.797281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:24:55.797281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:24:55.797281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df6c7382-2e3c-43bd-b678-327aea25a957 could not be found. May 27 15:24:55.797281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:24:55.797281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:55.797281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:24:55.797281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:55.797281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:55.797281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:55.797281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:24:55.797281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:24:55.797281 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:24:55.798809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:24:55.798809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:24:55.798809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:24:55.798809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:24:55.798809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:24:55.798809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:24:55.798809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:24:55.798809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df6c7382-2e3c-43bd-b678-327aea25a957 could not be found. May 27 15:24:55.798809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:24:55.798809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:24:55.798809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:24:55.798809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:24:55.798809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:24:55.798809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:24:55.798809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:24:55.798809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:24:55.798809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df6c7382-2e3c-43bd-b678-327aea25a957 could not be found. May 27 15:24:55.798809 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:24:55.800322 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-bdf41044-4c0e-4dbd-b38e-ad013cc64af0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Returning 404 to user: Instance df6c7382-2e3c-43bd-b678-327aea25a957 could not be found. {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:24:55.800322 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-bdf41044-4c0e-4dbd-b38e-ad013cc64af0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957" status: 404 len: 111 microversion: 2.1 time: 0.038849 May 27 15:24:55.800322 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 515/1049] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:55 2022] GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:24:55.808515 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-d4038665-4c12-4a6f-89d8-b6040e2916d3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '.version_select at 0x7f57e174cca0>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:55.828210 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-d4038665-4c12-4a6f-89d8-b6040e2916d3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1677654983" status: 202 len: 0 microversion: 2.1 time: 0.026334 May 27 15:24:55.829005 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 535/1050] 10.222.0.50 () {58 vars in 1220 bytes} [Fri May 27 15:24:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1677654983 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:24:56.614913 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-4ae7a998-3ba4-4f89-b763-8e538e753827 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:56.615708 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-4ae7a998-3ba4-4f89-b763-8e538e753827 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:56.622640 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4ae7a998-3ba4-4f89-b763-8e538e753827 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:56.623335 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4ae7a998-3ba4-4f89-b763-8e538e753827 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:56.624284 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4ae7a998-3ba4-4f89-b763-8e538e753827 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:56.624886 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-4ae7a998-3ba4-4f89-b763-8e538e753827 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:56.721787 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.objects.instance [None req-4ae7a998-3ba4-4f89-b763-8e538e753827 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lazy-loading 'services' on Instance uuid 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e {{(pid=117743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:24:56.807727 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-4ae7a998-3ba4-4f89-b763-8e538e753827 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e/os-volume_attachments/a63f5c00-1d56-41b9-9327-b3563b987ff0" status: 202 len: 0 microversion: 2.1 time: 0.196539 May 27 15:24:56.809151 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 516/1051] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 15:24:56 2022] DELETE /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e/os-volume_attachments/a63f5c00-1d56-41b9-9327-b3563b987ff0 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:24:56.823206 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-eadcc98e-1474-4df9-9742-b7eea0cbaee5 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:56.827332 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-eadcc98e-1474-4df9-9742-b7eea0cbaee5 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:56.838689 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-eadcc98e-1474-4df9-9742-b7eea0cbaee5 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:56.839245 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-eadcc98e-1474-4df9-9742-b7eea0cbaee5 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:56.840283 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-eadcc98e-1474-4df9-9742-b7eea0cbaee5 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:56.841065 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-eadcc98e-1474-4df9-9742-b7eea0cbaee5 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:56.873066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-eadcc98e-1474-4df9-9742-b7eea0cbaee5 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059385 May 27 15:24:56.873753 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 536/1052] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 15:24:56 2022] GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:24:57.886830 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-fc79b54d-fb1d-4f75-bd19-e6b77d4fbc3a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:57.887948 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-fc79b54d-fb1d-4f75-bd19-e6b77d4fbc3a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:57.897384 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fc79b54d-fb1d-4f75-bd19-e6b77d4fbc3a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:57.898104 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fc79b54d-fb1d-4f75-bd19-e6b77d4fbc3a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:57.898925 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fc79b54d-fb1d-4f75-bd19-e6b77d4fbc3a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:57.900228 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-fc79b54d-fb1d-4f75-bd19-e6b77d4fbc3a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:57.933403 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-fc79b54d-fb1d-4f75-bd19-e6b77d4fbc3a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052176 May 27 15:24:57.934544 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 517/1053] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 15:24:57 2022] GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:24:58.008765 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-51936200-260b-4898-9584-60d0d9abe77a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:58.010052 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-51936200-260b-4898-9584-60d0d9abe77a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:58.016812 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-51936200-260b-4898-9584-60d0d9abe77a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:58.017263 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-51936200-260b-4898-9584-60d0d9abe77a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:58.018039 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-51936200-260b-4898-9584-60d0d9abe77a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:58.018621 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-51936200-260b-4898-9584-60d0d9abe77a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:58.058192 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-51936200-260b-4898-9584-60d0d9abe77a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Going to try to terminate instance {{(pid=117742) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:24:58.123899 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:24:58.164212 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-51936200-260b-4898-9584-60d0d9abe77a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e" status: 204 len: 0 microversion: 2.1 time: 0.159843 May 27 15:24:58.168289 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 537/1054] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:24:58 2022] DELETE /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:24:58.173968 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b6d1c178-85e8-47a7-b459-a70bee8103c3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:58.174787 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b6d1c178-85e8-47a7-b459-a70bee8103c3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:58.181283 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b6d1c178-85e8-47a7-b459-a70bee8103c3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:58.181991 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b6d1c178-85e8-47a7-b459-a70bee8103c3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:58.182837 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b6d1c178-85e8-47a7-b459-a70bee8103c3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:58.183382 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b6d1c178-85e8-47a7-b459-a70bee8103c3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:58.315226 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b6d1c178-85e8-47a7-b459-a70bee8103c3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:58.323568 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b6d1c178-85e8-47a7-b459-a70bee8103c3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e" status: 200 len: 1679 microversion: 2.1 time: 0.153917 May 27 15:24:58.324229 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 518/1055] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:58 2022] GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:24:59.342184 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-1f476004-bb7a-41a6-972c-915949acd9bd tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:24:59.342805 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-1f476004-bb7a-41a6-972c-915949acd9bd tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:24:59.349642 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1f476004-bb7a-41a6-972c-915949acd9bd tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:59.350427 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1f476004-bb7a-41a6-972c-915949acd9bd tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:59.351304 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1f476004-bb7a-41a6-972c-915949acd9bd tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:24:59.351740 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1f476004-bb7a-41a6-972c-915949acd9bd tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:24:59.483540 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-1f476004-bb7a-41a6-972c-915949acd9bd tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:24:59.491671 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-1f476004-bb7a-41a6-972c-915949acd9bd tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e" status: 200 len: 1679 microversion: 2.1 time: 0.153969 May 27 15:24:59.492424 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 538/1056] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:24:59 2022] GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:00.509527 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-ed1f583d-ae0a-439e-a291-a6e80ced71e5 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:00.510146 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-ed1f583d-ae0a-439e-a291-a6e80ced71e5 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:00.527766 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ed1f583d-ae0a-439e-a291-a6e80ced71e5 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:00.538341 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ed1f583d-ae0a-439e-a291-a6e80ced71e5 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:00.548347 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ed1f583d-ae0a-439e-a291-a6e80ced71e5 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:00.548924 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ed1f583d-ae0a-439e-a291-a6e80ced71e5 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:00.735278 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-ed1f583d-ae0a-439e-a291-a6e80ced71e5 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:00.746633 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-ed1f583d-ae0a-439e-a291-a6e80ced71e5 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e" status: 200 len: 1679 microversion: 2.1 time: 0.240287 May 27 15:25:00.762465 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 519/1057] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:25:00 2022] GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e => generated 1679 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:01.452435 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-399d0253-91d4-4342-9ab4-b5f5fe487828 req-7a92c602-835a-4481-8fe7-34c9b63d002e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e", "name": "network-vif-deleted", "tag": "0f125be5-109c-4c09-aa99-7071bcb30bbc"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:25:01.473018 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-399d0253-91d4-4342-9ab4-b5f5fe487828 req-7a92c602-835a-4481-8fe7-34c9b63d002e service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:01.475793 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-399d0253-91d4-4342-9ab4-b5f5fe487828 req-7a92c602-835a-4481-8fe7-34c9b63d002e service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:01.490336 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-399d0253-91d4-4342-9ab4-b5f5fe487828 req-7a92c602-835a-4481-8fe7-34c9b63d002e service nova] Creating event network-vif-deleted:0f125be5-109c-4c09-aa99-7071bcb30bbc for instance 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e on hv-cinder-84254 May 27 15:25:01.497416 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-399d0253-91d4-4342-9ab4-b5f5fe487828 req-7a92c602-835a-4481-8fe7-34c9b63d002e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048850 May 27 15:25:01.502476 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 539/1058] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:25:01.767072 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-114828a1-2ef5-4818-9711-3925213dec66 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:01.768312 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-114828a1-2ef5-4818-9711-3925213dec66 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:01.776999 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-114828a1-2ef5-4818-9711-3925213dec66 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:01.777468 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-114828a1-2ef5-4818-9711-3925213dec66 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:01.779076 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-114828a1-2ef5-4818-9711-3925213dec66 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:01.779721 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-114828a1-2ef5-4818-9711-3925213dec66 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:01.815050 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-114828a1-2ef5-4818-9711-3925213dec66 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:01.815922 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-114828a1-2ef5-4818-9711-3925213dec66 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:01.816532 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.objects.instance [None req-114828a1-2ef5-4818-9711-3925213dec66 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lazy-loading 'fault' on Instance uuid 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e {{(pid=117743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:25:01.876160 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-114828a1-2ef5-4818-9711-3925213dec66 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:01.885946 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-114828a1-2ef5-4818-9711-3925213dec66 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e" status: 200 len: 1332 microversion: 2.1 time: 0.125503 May 27 15:25:01.886684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 520/1059] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:25:01 2022] GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e => generated 1332 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:25:02.905325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8801f705-c261-49bb-b7e6-f3b9a04ade39 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:02.906029 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-8801f705-c261-49bb-b7e6-f3b9a04ade39 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:02.912707 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8801f705-c261-49bb-b7e6-f3b9a04ade39 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:02.913152 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8801f705-c261-49bb-b7e6-f3b9a04ade39 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:02.913923 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8801f705-c261-49bb-b7e6-f3b9a04ade39 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:02.914356 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8801f705-c261-49bb-b7e6-f3b9a04ade39 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:02.929354 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-8801f705-c261-49bb-b7e6-f3b9a04ade39 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] HTTP exception thrown: Instance 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e could not be found. May 27 15:25:02.931618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8801f705-c261-49bb-b7e6-f3b9a04ade39 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Request method failure captured: May 27 15:25:02.931618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e HTTP/1.1 May 27 15:25:02.931618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:25:02.931618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:25:02.931618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:25:02.931618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:25:02.931618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:25:02.931618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:25:02.931618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:25:02.931618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:25:02.931618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOzNSb8dAVARh41NDH1neBeIQ7mEiYGzluZ1aLHWr-bZMM8Yk3DEMls-W331t4g56BKuQBAiw5JIF3Yut9sBSPvmBYrZo49s8qFM14ylIEBI_1nGqB4zBnvHBSyTSPec4EhH5fjot66Y9DnhxIGyrqIMzSWHLKve581Z3mM8_f45p1g May 27 15:25:02.931618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:25:02.931618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:25:02.931618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:25:02.931618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:25:02.931618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:25:02.931618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:25:02.931618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:25:02.931618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:25:02.931618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:25:02.931618 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:25:02.933345 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f027c3b75bc6430abd765a26269f9058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:25:02.933345 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:25:02.933345 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:25:02.933345 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:25:02.933345 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:25:02.933345 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:25:02.933345 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:25:02.933345 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: b1302d3b8649407ca010f12aad7a6597 May 27 15:25:02.933345 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:25:02.933345 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:25:02.933345 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e could not be found. May 27 15:25:02.933345 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': '8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e'} May 27 15:25:02.934271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:25:02.934271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:25:02.934271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:25:02.934271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:25:02.934271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:25:02.934271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:25:02.934271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:25:02.934271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:25:02.934271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:25:02.934271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:25:02.934271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e could not be found. May 27 15:25:02.934271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:25:02.934271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:25:02.934271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:25:02.934271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:25:02.934271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:25:02.934271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:25:02.934271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:25:02.934271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:25:02.934271 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:25:02.937414 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:25:02.937414 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:25:02.937414 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:25:02.937414 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:25:02.937414 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:25:02.937414 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:25:02.937414 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:25:02.937414 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e could not be found. May 27 15:25:02.937414 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:25:02.937414 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:25:02.937414 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:25:02.937414 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:25:02.937414 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:25:02.937414 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:25:02.937414 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:25:02.937414 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:25:02.937414 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e could not be found. May 27 15:25:02.937414 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:25:02.939583 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8801f705-c261-49bb-b7e6-f3b9a04ade39 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Returning 404 to user: Instance 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:25:02.939583 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-8801f705-c261-49bb-b7e6-f3b9a04ade39 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e" status: 404 len: 111 microversion: 2.1 time: 0.032899 May 27 15:25:02.939583 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 540/1060] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:25:02 2022] GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:25:02.942339 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-4c0f0b5f-3b1d-4ed5-9a63-4de3093663ee tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '.version_select at 0x7f57e218e670>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:02.961715 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-4c0f0b5f-3b1d-4ed5-9a63-4de3093663ee tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1356387303" status: 202 len: 0 microversion: 2.1 time: 0.023119 May 27 15:25:02.962500 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 521/1061] 10.222.0.50 () {58 vars in 1220 bytes} [Fri May 27 15:25:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1356387303 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:25:03.576571 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-6531a00f-4522-4bb9-ab36-fcea251ab5dd tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Action: 'create', calling method: .version_select at 0x7f57e1722040>, body: {"keypair": {"name": "tempest-keypair-789247466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7ondpnf6/beCOPYGMcY8iyA9IAqd5F4I3HpyQpLAzfqHAzjMRVc++vjotU2gFZqgg8Oqd6V6w83vODUTEtLZ3J3yp3syV4hzWuUxVHa+vedhG/UxLu2WVMtPNe1MSGMw=="}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:25:03.590910 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-6531a00f-4522-4bb9-ab36-fcea251ab5dd tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Getting quotas for project f027c3b75bc6430abd765a26269f9058. Resources: {'key_pairs'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:25:03.595445 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-6531a00f-4522-4bb9-ab36-fcea251ab5dd tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Getting quotas for user b1302d3b8649407ca010f12aad7a6597 and project f027c3b75bc6430abd765a26269f9058. Resources: {'key_pairs'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:25:03.616570 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-6531a00f-4522-4bb9-ab36-fcea251ab5dd tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043961 May 27 15:25:03.617149 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 541/1062] 10.222.0.50 () {60 vars in 1158 bytes} [Fri May 27 15:25:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:25:05.155521 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-67d513d6-3c82-4315-9538-926575760ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-41753268", "imageRef": "a9407644-1f68-43e6-beb1-ce2085766180", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b7857e3-255b-417e-82ed-fcdb2806f57d"}], "security_groups": [{"name": "tempest-securitygroup--417620996"}], "key_name": "tempest-keypair-789247466", "user_data": "}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:25:05.254932 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.network.neutron [None req-67d513d6-3c82-4315-9538-926575760ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] validate_networks() for [('6b7857e3-255b-417e-82ed-fcdb2806f57d', None, None, None, None, None)] {{(pid=117743) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:25:05.723802 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-67d513d6-3c82-4315-9538-926575760ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Flavor limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:25:05.724228 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-67d513d6-3c82-4315-9538-926575760ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Image limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:25:05.724728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-67d513d6-3c82-4315-9538-926575760ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Flavor pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:25:05.725137 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-67d513d6-3c82-4315-9538-926575760ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Image pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:25:05.725547 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-67d513d6-3c82-4315-9538-926575760ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:25:05.735585 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-67d513d6-3c82-4315-9538-926575760ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:05.736030 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-67d513d6-3c82-4315-9538-926575760ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:05.736824 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-67d513d6-3c82-4315-9538-926575760ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:05.737258 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-67d513d6-3c82-4315-9538-926575760ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:05.744080 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:05.757096 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-67d513d6-3c82-4315-9538-926575760ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Getting quotas for project f027c3b75bc6430abd765a26269f9058. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:25:05.761162 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-67d513d6-3c82-4315-9538-926575760ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Getting quotas for user b1302d3b8649407ca010f12aad7a6597 and project f027c3b75bc6430abd765a26269f9058. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:25:05.771976 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-67d513d6-3c82-4315-9538-926575760ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Going to run 1 instances... {{(pid=117743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:25:05.774749 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-67d513d6-3c82-4315-9538-926575760ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9407644-1f68-43e6-beb1-ce2085766180',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:25:05.819184 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-67d513d6-3c82-4315-9538-926575760ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.668514 May 27 15:25:05.819827 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 522/1063] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 15:25:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:25:05.830390 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-3da3a085-337d-4c0f-9964-f857dc8a62a7 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:05.831033 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-3da3a085-337d-4c0f-9964-f857dc8a62a7 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:05.892036 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-3da3a085-337d-4c0f-9964-f857dc8a62a7 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:05.898801 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-3da3a085-337d-4c0f-9964-f857dc8a62a7 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9" status: 200 len: 1239 microversion: 2.1 time: 0.072873 May 27 15:25:05.900014 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 542/1064] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:25:05 2022] GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9 => generated 1239 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:06.916156 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-37a6965d-7f13-4c74-b07c-5961cee3e659 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:06.916771 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-37a6965d-7f13-4c74-b07c-5961cee3e659 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:06.922842 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-37a6965d-7f13-4c74-b07c-5961cee3e659 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:06.923319 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-37a6965d-7f13-4c74-b07c-5961cee3e659 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:06.924084 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-37a6965d-7f13-4c74-b07c-5961cee3e659 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:06.924518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-37a6965d-7f13-4c74-b07c-5961cee3e659 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:06.987754 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-37a6965d-7f13-4c74-b07c-5961cee3e659 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:06.995341 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-37a6965d-7f13-4c74-b07c-5961cee3e659 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9" status: 200 len: 1291 microversion: 2.1 time: 0.083753 May 27 15:25:06.995908 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 523/1065] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:25:06 2022] GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9 => generated 1291 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:08.012032 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-af541e69-5cb2-40f0-af6e-956419840fd0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:08.012655 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-af541e69-5cb2-40f0-af6e-956419840fd0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:08.019305 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-af541e69-5cb2-40f0-af6e-956419840fd0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:08.019755 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-af541e69-5cb2-40f0-af6e-956419840fd0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:08.020616 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-af541e69-5cb2-40f0-af6e-956419840fd0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:08.021046 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-af541e69-5cb2-40f0-af6e-956419840fd0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:08.158374 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-af541e69-5cb2-40f0-af6e-956419840fd0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:08.167945 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-af541e69-5cb2-40f0-af6e-956419840fd0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9" status: 200 len: 1364 microversion: 2.1 time: 0.159877 May 27 15:25:08.168634 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 543/1066] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:25:08 2022] GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:25:08.636032 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-811f5c40-da38-4919-9252-90003be99e53 req-4dc32117-42cc-4308-9cf8-f238e32774a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe790e7-3765-4759-9108-4ce3101e56f9", "tag": "d62940e2-5ff9-417d-ba02-477af23a53ef"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:25:08.645858 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-811f5c40-da38-4919-9252-90003be99e53 req-4dc32117-42cc-4308-9cf8-f238e32774a1 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:08.646612 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-811f5c40-da38-4919-9252-90003be99e53 req-4dc32117-42cc-4308-9cf8-f238e32774a1 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:08.661071 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-811f5c40-da38-4919-9252-90003be99e53 req-4dc32117-42cc-4308-9cf8-f238e32774a1 service nova] Creating event network-changed:d62940e2-5ff9-417d-ba02-477af23a53ef for instance afe790e7-3765-4759-9108-4ce3101e56f9 on hv-cinder-84254 May 27 15:25:08.666416 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-811f5c40-da38-4919-9252-90003be99e53 req-4dc32117-42cc-4308-9cf8-f238e32774a1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034883 May 27 15:25:08.667085 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 524/1067] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 15:25:09.185631 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-02f9450c-c026-4c5b-8c6f-15825a5ad335 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:09.186239 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-02f9450c-c026-4c5b-8c6f-15825a5ad335 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:09.192675 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-02f9450c-c026-4c5b-8c6f-15825a5ad335 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:09.193116 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-02f9450c-c026-4c5b-8c6f-15825a5ad335 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:09.193870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-02f9450c-c026-4c5b-8c6f-15825a5ad335 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:09.194300 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-02f9450c-c026-4c5b-8c6f-15825a5ad335 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:09.326576 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-02f9450c-c026-4c5b-8c6f-15825a5ad335 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:09.334070 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-02f9450c-c026-4c5b-8c6f-15825a5ad335 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9" status: 200 len: 1364 microversion: 2.1 time: 0.152245 May 27 15:25:09.334636 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 544/1068] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:25:09 2022] GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:10.355796 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b3b70b48-4408-4049-9b3f-c31d5229d19e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:10.356739 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b3b70b48-4408-4049-9b3f-c31d5229d19e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:10.365550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b3b70b48-4408-4049-9b3f-c31d5229d19e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:10.366041 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b3b70b48-4408-4049-9b3f-c31d5229d19e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:10.366893 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b3b70b48-4408-4049-9b3f-c31d5229d19e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:10.367371 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b3b70b48-4408-4049-9b3f-c31d5229d19e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:10.506279 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b3b70b48-4408-4049-9b3f-c31d5229d19e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:10.514627 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b3b70b48-4408-4049-9b3f-c31d5229d19e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9" status: 200 len: 1364 microversion: 2.1 time: 0.166339 May 27 15:25:10.515238 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 525/1069] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:25:10 2022] GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:11.531568 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-92e9b155-dedc-42e5-8ca8-c4dcbecbf424 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:11.532220 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-92e9b155-dedc-42e5-8ca8-c4dcbecbf424 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:11.534617 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=4,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:11.540095 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-92e9b155-dedc-42e5-8ca8-c4dcbecbf424 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:11.540545 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-92e9b155-dedc-42e5-8ca8-c4dcbecbf424 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:11.541307 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-92e9b155-dedc-42e5-8ca8-c4dcbecbf424 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:11.541742 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-92e9b155-dedc-42e5-8ca8-c4dcbecbf424 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:11.670539 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-92e9b155-dedc-42e5-8ca8-c4dcbecbf424 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:11.677987 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-92e9b155-dedc-42e5-8ca8-c4dcbecbf424 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9" status: 200 len: 1364 microversion: 2.1 time: 0.150331 May 27 15:25:11.678556 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 545/1070] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:25:11 2022] GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:12.699325 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b5ecfb59-bff1-4220-bf39-02098aea00e4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:12.699882 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b5ecfb59-bff1-4220-bf39-02098aea00e4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:12.702307 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:12.707763 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b5ecfb59-bff1-4220-bf39-02098aea00e4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:12.708283 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b5ecfb59-bff1-4220-bf39-02098aea00e4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:12.708980 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b5ecfb59-bff1-4220-bf39-02098aea00e4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:12.709414 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b5ecfb59-bff1-4220-bf39-02098aea00e4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:12.847427 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-b5ecfb59-bff1-4220-bf39-02098aea00e4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:12.855602 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b5ecfb59-bff1-4220-bf39-02098aea00e4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9" status: 200 len: 1364 microversion: 2.1 time: 0.160490 May 27 15:25:12.856170 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 526/1071] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:25:12 2022] GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:25:13.873086 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-dcd700ee-afec-4fff-853d-6eac7c7da58d tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:13.873675 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-dcd700ee-afec-4fff-853d-6eac7c7da58d tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:13.881412 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-dcd700ee-afec-4fff-853d-6eac7c7da58d tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:13.881919 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-dcd700ee-afec-4fff-853d-6eac7c7da58d tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:13.882755 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-dcd700ee-afec-4fff-853d-6eac7c7da58d tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:13.883312 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-dcd700ee-afec-4fff-853d-6eac7c7da58d tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:14.011965 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-dcd700ee-afec-4fff-853d-6eac7c7da58d tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:14.025600 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-dcd700ee-afec-4fff-853d-6eac7c7da58d tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9" status: 200 len: 1364 microversion: 2.1 time: 0.156724 May 27 15:25:14.026194 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 546/1072] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:25:13 2022] GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:14.559801 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-5e914b60-fa47-4c83-9d7b-ae23ada6ca30 req-2adf246a-31ac-4e17-b65c-721988b03ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe790e7-3765-4759-9108-4ce3101e56f9", "name": "network-vif-plugged", "status": "completed", "tag": "d62940e2-5ff9-417d-ba02-477af23a53ef"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:25:14.570405 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-5e914b60-fa47-4c83-9d7b-ae23ada6ca30 req-2adf246a-31ac-4e17-b65c-721988b03ab1 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:14.571376 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-5e914b60-fa47-4c83-9d7b-ae23ada6ca30 req-2adf246a-31ac-4e17-b65c-721988b03ab1 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:14.583649 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-5e914b60-fa47-4c83-9d7b-ae23ada6ca30 req-2adf246a-31ac-4e17-b65c-721988b03ab1 service nova] Creating event network-vif-plugged:d62940e2-5ff9-417d-ba02-477af23a53ef for instance afe790e7-3765-4759-9108-4ce3101e56f9 on hv-cinder-84254 May 27 15:25:14.589778 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-5e914b60-fa47-4c83-9d7b-ae23ada6ca30 req-2adf246a-31ac-4e17-b65c-721988b03ab1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033768 May 27 15:25:14.590543 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 527/1073] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:25:15.042541 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-9578c957-da62-4f99-9dc0-0841252a4b58 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:15.043173 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-9578c957-da62-4f99-9dc0-0841252a4b58 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:15.049917 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9578c957-da62-4f99-9dc0-0841252a4b58 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:15.050362 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9578c957-da62-4f99-9dc0-0841252a4b58 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:15.051149 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9578c957-da62-4f99-9dc0-0841252a4b58 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:15.051579 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-9578c957-da62-4f99-9dc0-0841252a4b58 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:15.184570 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-9578c957-da62-4f99-9dc0-0841252a4b58 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:15.192070 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-9578c957-da62-4f99-9dc0-0841252a4b58 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9" status: 200 len: 1364 microversion: 2.1 time: 0.153410 May 27 15:25:15.192660 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 547/1074] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:25:15 2022] GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:16.207030 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=2 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:16.207719 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=6 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:16.211799 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-c3200a2b-ca01-45fc-9719-bac4a094f092 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:16.213127 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-c3200a2b-ca01-45fc-9719-bac4a094f092 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:16.220522 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c3200a2b-ca01-45fc-9719-bac4a094f092 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:16.220934 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c3200a2b-ca01-45fc-9719-bac4a094f092 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:16.221697 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c3200a2b-ca01-45fc-9719-bac4a094f092 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:16.222134 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c3200a2b-ca01-45fc-9719-bac4a094f092 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:16.354482 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-c3200a2b-ca01-45fc-9719-bac4a094f092 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:16.361985 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-c3200a2b-ca01-45fc-9719-bac4a094f092 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9" status: 200 len: 1364 microversion: 2.1 time: 0.156506 May 27 15:25:16.362550 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 528/1075] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:25:16 2022] GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:17.379488 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e1345923-acea-4083-a7ae-0db358fd5505 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:17.380095 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e1345923-acea-4083-a7ae-0db358fd5505 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:17.381905 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=6 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:17.387878 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e1345923-acea-4083-a7ae-0db358fd5505 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:17.388340 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e1345923-acea-4083-a7ae-0db358fd5505 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:17.389072 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e1345923-acea-4083-a7ae-0db358fd5505 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:17.389501 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e1345923-acea-4083-a7ae-0db358fd5505 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:17.520130 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-e1345923-acea-4083-a7ae-0db358fd5505 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:25:17.527709 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-e1345923-acea-4083-a7ae-0db358fd5505 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9" status: 200 len: 1553 microversion: 2.1 time: 0.152060 May 27 15:25:17.528284 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 548/1076] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:25:17 2022] GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:25:17.544519 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-258325ec-7ada-4d7c-870f-c2cdbd4dabc8 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:17.545017 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-258325ec-7ada-4d7c-870f-c2cdbd4dabc8 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:17.551441 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-258325ec-7ada-4d7c-870f-c2cdbd4dabc8 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:17.551896 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-258325ec-7ada-4d7c-870f-c2cdbd4dabc8 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:17.552658 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-258325ec-7ada-4d7c-870f-c2cdbd4dabc8 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:17.553096 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-258325ec-7ada-4d7c-870f-c2cdbd4dabc8 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:17.629846 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-258325ec-7ada-4d7c-870f-c2cdbd4dabc8 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089648 May 27 15:25:17.630441 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 529/1077] 10.222.0.50 () {58 vars in 1274 bytes} [Fri May 27 15:25:17 2022] GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:25:18.651804 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-2d4fb3a2-b04d-47bb-a6db-f702c9d17b51 req-a2425772-201b-4098-8be0-d8ca6f798fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe790e7-3765-4759-9108-4ce3101e56f9", "tag": "d62940e2-5ff9-417d-ba02-477af23a53ef"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:25:18.659973 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-2d4fb3a2-b04d-47bb-a6db-f702c9d17b51 req-a2425772-201b-4098-8be0-d8ca6f798fe2 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:18.660414 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-2d4fb3a2-b04d-47bb-a6db-f702c9d17b51 req-a2425772-201b-4098-8be0-d8ca6f798fe2 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:18.674301 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-2d4fb3a2-b04d-47bb-a6db-f702c9d17b51 req-a2425772-201b-4098-8be0-d8ca6f798fe2 service nova] Creating event network-changed:d62940e2-5ff9-417d-ba02-477af23a53ef for instance afe790e7-3765-4759-9108-4ce3101e56f9 on hv-cinder-84254 May 27 15:25:18.678917 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-2d4fb3a2-b04d-47bb-a6db-f702c9d17b51 req-a2425772-201b-4098-8be0-d8ca6f798fe2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151912 May 27 15:25:18.679562 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 549/1078] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:25:54.445514 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_api:SELECT=7 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:54.446229 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=32 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:54.450251 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-c25079a3-9026-48f4-9763-af0542100390 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:25:54.450728 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-c25079a3-9026-48f4-9763-af0542100390 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:54.458406 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c25079a3-9026-48f4-9763-af0542100390 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:54.458871 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c25079a3-9026-48f4-9763-af0542100390 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:54.459651 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c25079a3-9026-48f4-9763-af0542100390 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:54.460089 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-c25079a3-9026-48f4-9763-af0542100390 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:54.484256 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-c25079a3-9026-48f4-9763-af0542100390 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9/ips" status: 200 len: 149 microversion: 2.1 time: 0.040227 May 27 15:25:54.484833 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 530/1079] 10.222.0.50 () {58 vars in 1247 bytes} [Fri May 27 15:25:54 2022] GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:25:55.797517 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=9 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:55.798842 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=48 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:25:55.803084 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-f08406ed-e01b-4c07-b526-ca514da96212 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe325278-5ed0-423d-a6ab-aa534183e1b0"}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:25:55.804242 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-f08406ed-e01b-4c07-b526-ca514da96212 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:25:55.811131 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f08406ed-e01b-4c07-b526-ca514da96212 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:55.811575 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f08406ed-e01b-4c07-b526-ca514da96212 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:55.812334 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f08406ed-e01b-4c07-b526-ca514da96212 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:25:55.812767 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-f08406ed-e01b-4c07-b526-ca514da96212 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:25:56.080044 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-f08406ed-e01b-4c07-b526-ca514da96212 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "POST /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283694 May 27 15:25:56.080652 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 550/1080] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 15:25:55 2022] POST /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:26:03.581023 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-6f1b9753-3fae-4814-9c54-9d7b0bec02cd tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe325278-5ed0-423d-a6ab-aa534183e1b0"}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:03.582079 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-6f1b9753-3fae-4814-9c54-9d7b0bec02cd tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:03.588727 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6f1b9753-3fae-4814-9c54-9d7b0bec02cd tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:03.589178 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6f1b9753-3fae-4814-9c54-9d7b0bec02cd tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:03.589945 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6f1b9753-3fae-4814-9c54-9d7b0bec02cd tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:03.590384 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6f1b9753-3fae-4814-9c54-9d7b0bec02cd tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:03.669328 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-6f1b9753-3fae-4814-9c54-9d7b0bec02cd tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] HTTP exception thrown: Invalid volume: volume fe325278-5ed0-423d-a6ab-aa534183e1b0 is already attached to instances: afe790e7-3765-4759-9108-4ce3101e56f9 May 27 15:26:03.671140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-6f1b9753-3fae-4814-9c54-9d7b0bec02cd tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Request method failure captured: May 27 15:26:03.671140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: POST /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9/os-volume_attachments HTTP/1.1 May 27 15:26:03.671140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:26:03.671140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:26:03.671140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:26:03.671140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 74 May 27 15:26:03.671140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:26:03.671140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:26:03.671140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:26:03.671140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:26:03.671140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOzNSb8dAVARh41NDH1neBeIQ7mEiYGzluZ1aLHWr-bZMM8Yk3DEMls-W331t4g56BKuQBAiw5JIF3Yut9sBSPvmBYrZo49s8qFM14ylIEBI_1nGqB4zBnvHBSyTSPec4EhH5fjot66Y9DnhxIGyrqIMzSWHLKve581Z3mM8_f45p1g May 27 15:26:03.671140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:26:03.671140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:26:03.671140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:26:03.671140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:26:03.671140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:26:03.671140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:26:03.671140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:26:03.671140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:26:03.671140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:26:03.671140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:26:03.673090 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f027c3b75bc6430abd765a26269f9058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:26:03.673090 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:26:03.673090 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:26:03.673090 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:26:03.673090 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:26:03.673090 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:26:03.673090 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:26:03.673090 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: b1302d3b8649407ca010f12aad7a6597 May 27 15:26:03.673090 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:26:03.673090 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: May 27 15:26:03.673090 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {"volumeAttachment": {"volumeId": "fe325278-5ed0-423d-a6ab-aa534183e1b0"}} May 27 15:26:03.673090 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: > May 27 15:26:03.674140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Invalid volume: volume fe325278-5ed0-423d-a6ab-aa534183e1b0 is already attached to instances: afe790e7-3765-4759-9108-4ce3101e56f9 May 27 15:26:03.674140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'server_id': 'afe790e7-3765-4759-9108-4ce3101e56f9', 'body': {'volumeAttachment': {'volumeId': 'fe325278-5ed0-423d-a6ab-aa534183e1b0'}}} May 27 15:26:03.674140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:26:03.674140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:03.674140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 15:26:03.674140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 15:26:03.674140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 15:26:03.674140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 15:26:03.674140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 27 15:26:03.674140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 15:26:03.674140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 27 15:26:03.674140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 27 15:26:03.674140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 27 15:26:03.674140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 27 15:26:03.674140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fe325278-5ed0-423d-a6ab-aa534183e1b0 is already attached to instances: afe790e7-3765-4759-9108-4ce3101e56f9 May 27 15:26:03.674140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:26:03.674140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:03.674140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:26:03.674140 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:03.675523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:03.675523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:03.675523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:26:03.675523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:26:03.675523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:26:03.675523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:26:03.675523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:26:03.675523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:26:03.675523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:26:03.675523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:26:03.675523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 15:26:03.675523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 15:26:03.675523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 27 15:26:03.675523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 27 15:26:03.675523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fe325278-5ed0-423d-a6ab-aa534183e1b0 is already attached to instances: afe790e7-3765-4759-9108-4ce3101e56f9 May 27 15:26:03.675523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:26:03.675523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:03.675523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:26:03.675523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:03.675523 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:03.676871 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:03.676871 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:26:03.676871 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:26:03.676871 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fe325278-5ed0-423d-a6ab-aa534183e1b0 is already attached to instances: afe790e7-3765-4759-9108-4ce3101e56f9 May 27 15:26:03.676871 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:26:03.676871 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-6f1b9753-3fae-4814-9c54-9d7b0bec02cd tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Returning 400 to user: Invalid volume: volume fe325278-5ed0-423d-a6ab-aa534183e1b0 is already attached to instances: afe790e7-3765-4759-9108-4ce3101e56f9 {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:26:03.676871 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-6f1b9753-3fae-4814-9c54-9d7b0bec02cd tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "POST /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096180 May 27 15:26:03.676871 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 531/1081] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 15:26:03 2022] POST /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 15:26:03.740692 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-1132e031-a9a4-44f1-8875-de2d39abfa4b tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:03.741295 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-1132e031-a9a4-44f1-8875-de2d39abfa4b tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:03.747623 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1132e031-a9a4-44f1-8875-de2d39abfa4b tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:03.748063 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1132e031-a9a4-44f1-8875-de2d39abfa4b tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:03.748815 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1132e031-a9a4-44f1-8875-de2d39abfa4b tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:03.749248 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1132e031-a9a4-44f1-8875-de2d39abfa4b tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:03.830066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.objects.instance [None req-1132e031-a9a4-44f1-8875-de2d39abfa4b tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lazy-loading 'services' on Instance uuid afe790e7-3765-4759-9108-4ce3101e56f9 {{(pid=117742) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:26:03.899662 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-1132e031-a9a4-44f1-8875-de2d39abfa4b tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "DELETE /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9/os-volume_attachments/fe325278-5ed0-423d-a6ab-aa534183e1b0" status: 202 len: 0 microversion: 2.1 time: 0.163709 May 27 15:26:03.900236 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 551/1082] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 15:26:03 2022] DELETE /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9/os-volume_attachments/fe325278-5ed0-423d-a6ab-aa534183e1b0 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:26:03.908952 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-8c15b401-74e5-4f98-8dd2-3bd0d9db7272 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:03.909882 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-8c15b401-74e5-4f98-8dd2-3bd0d9db7272 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:03.916273 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8c15b401-74e5-4f98-8dd2-3bd0d9db7272 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:03.916730 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8c15b401-74e5-4f98-8dd2-3bd0d9db7272 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:03.917503 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8c15b401-74e5-4f98-8dd2-3bd0d9db7272 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:03.917943 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8c15b401-74e5-4f98-8dd2-3bd0d9db7272 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:03.948902 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-8c15b401-74e5-4f98-8dd2-3bd0d9db7272 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044028 May 27 15:26:03.949491 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 532/1083] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 15:26:03 2022] GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:26:04.961939 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-1ad32326-dd75-4c9d-b41f-ad681f42ffe0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:04.963018 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-1ad32326-dd75-4c9d-b41f-ad681f42ffe0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:04.969960 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1ad32326-dd75-4c9d-b41f-ad681f42ffe0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:04.970987 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1ad32326-dd75-4c9d-b41f-ad681f42ffe0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:04.971755 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1ad32326-dd75-4c9d-b41f-ad681f42ffe0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:04.972188 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1ad32326-dd75-4c9d-b41f-ad681f42ffe0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:05.001301 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-1ad32326-dd75-4c9d-b41f-ad681f42ffe0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043832 May 27 15:26:05.001935 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 552/1084] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 15:26:04 2022] GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:26:05.061217 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-16298ca2-206a-409f-acd8-c557ae35ce0e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:05.061752 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-16298ca2-206a-409f-acd8-c557ae35ce0e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:05.068365 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-16298ca2-206a-409f-acd8-c557ae35ce0e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:05.068810 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-16298ca2-206a-409f-acd8-c557ae35ce0e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:05.069566 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-16298ca2-206a-409f-acd8-c557ae35ce0e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:05.070017 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-16298ca2-206a-409f-acd8-c557ae35ce0e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:05.096041 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-16298ca2-206a-409f-acd8-c557ae35ce0e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Going to try to terminate instance {{(pid=117743) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:26:05.182394 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-16298ca2-206a-409f-acd8-c557ae35ce0e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "DELETE /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9" status: 204 len: 0 microversion: 2.1 time: 0.124698 May 27 15:26:05.183099 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 533/1085] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:26:05 2022] DELETE /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:26:05.192407 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-747a60cb-a2ce-4448-9482-1faf1daebd6a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:05.193020 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-747a60cb-a2ce-4448-9482-1faf1daebd6a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:05.199091 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-747a60cb-a2ce-4448-9482-1faf1daebd6a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:05.199538 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-747a60cb-a2ce-4448-9482-1faf1daebd6a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:05.200309 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-747a60cb-a2ce-4448-9482-1faf1daebd6a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:05.200745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-747a60cb-a2ce-4448-9482-1faf1daebd6a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:05.334596 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-747a60cb-a2ce-4448-9482-1faf1daebd6a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:05.342159 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-747a60cb-a2ce-4448-9482-1faf1daebd6a tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9" status: 200 len: 1678 microversion: 2.1 time: 0.154918 May 27 15:26:05.342742 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 553/1086] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:26:05 2022] GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:06.361087 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-0058940e-a948-4afb-bf35-0677a5ab2fa3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:06.361799 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-0058940e-a948-4afb-bf35-0677a5ab2fa3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:06.368324 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0058940e-a948-4afb-bf35-0677a5ab2fa3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:06.368775 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0058940e-a948-4afb-bf35-0677a5ab2fa3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:06.369547 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0058940e-a948-4afb-bf35-0677a5ab2fa3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:06.369986 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-0058940e-a948-4afb-bf35-0677a5ab2fa3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:06.512446 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-0058940e-a948-4afb-bf35-0677a5ab2fa3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:06.519990 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-0058940e-a948-4afb-bf35-0677a5ab2fa3 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9" status: 200 len: 1678 microversion: 2.1 time: 0.163988 May 27 15:26:06.520561 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 534/1087] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:26:06 2022] GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:07.537336 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e8d8f684-8f0a-4ada-a23b-97979de175bf tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:07.538045 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e8d8f684-8f0a-4ada-a23b-97979de175bf tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:07.545104 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e8d8f684-8f0a-4ada-a23b-97979de175bf tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:07.545554 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e8d8f684-8f0a-4ada-a23b-97979de175bf tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:07.546324 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e8d8f684-8f0a-4ada-a23b-97979de175bf tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:07.546764 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e8d8f684-8f0a-4ada-a23b-97979de175bf tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:07.687154 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-e8d8f684-8f0a-4ada-a23b-97979de175bf tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:07.695458 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-e8d8f684-8f0a-4ada-a23b-97979de175bf tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9" status: 200 len: 1678 microversion: 2.1 time: 0.162172 May 27 15:26:07.696038 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 554/1088] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:26:07 2022] GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:07.993671 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-997cea6e-6bc9-437f-81fe-847f81fdbb02 req-bca8dd13-e87d-428c-a359-bcc67ba62469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe790e7-3765-4759-9108-4ce3101e56f9", "name": "network-vif-deleted", "tag": "d62940e2-5ff9-417d-ba02-477af23a53ef"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:08.006443 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-997cea6e-6bc9-437f-81fe-847f81fdbb02 req-bca8dd13-e87d-428c-a359-bcc67ba62469 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:08.007189 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-997cea6e-6bc9-437f-81fe-847f81fdbb02 req-bca8dd13-e87d-428c-a359-bcc67ba62469 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:08.022872 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-997cea6e-6bc9-437f-81fe-847f81fdbb02 req-bca8dd13-e87d-428c-a359-bcc67ba62469 service nova] Creating event network-vif-deleted:d62940e2-5ff9-417d-ba02-477af23a53ef for instance afe790e7-3765-4759-9108-4ce3101e56f9 on hv-cinder-84254 May 27 15:26:08.030347 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-997cea6e-6bc9-437f-81fe-847f81fdbb02 req-bca8dd13-e87d-428c-a359-bcc67ba62469 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117128 May 27 15:26:08.030987 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 535/1089] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:26:08.713392 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-aeea708a-b9c2-4a9f-ac63-91385d915440 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:08.714031 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-aeea708a-b9c2-4a9f-ac63-91385d915440 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:08.721718 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-aeea708a-b9c2-4a9f-ac63-91385d915440 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:08.722166 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-aeea708a-b9c2-4a9f-ac63-91385d915440 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:08.722967 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-aeea708a-b9c2-4a9f-ac63-91385d915440 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:08.723408 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-aeea708a-b9c2-4a9f-ac63-91385d915440 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:08.736781 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-aeea708a-b9c2-4a9f-ac63-91385d915440 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] HTTP exception thrown: Instance afe790e7-3765-4759-9108-4ce3101e56f9 could not be found. May 27 15:26:08.738453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-aeea708a-b9c2-4a9f-ac63-91385d915440 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Request method failure captured: May 27 15:26:08.738453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9 HTTP/1.1 May 27 15:26:08.738453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:26:08.738453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:26:08.738453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:26:08.738453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:26:08.738453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:26:08.738453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:26:08.738453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:26:08.738453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:26:08.738453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOzNSb8dAVARh41NDH1neBeIQ7mEiYGzluZ1aLHWr-bZMM8Yk3DEMls-W331t4g56BKuQBAiw5JIF3Yut9sBSPvmBYrZo49s8qFM14ylIEBI_1nGqB4zBnvHBSyTSPec4EhH5fjot66Y9DnhxIGyrqIMzSWHLKve581Z3mM8_f45p1g May 27 15:26:08.738453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:26:08.738453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:26:08.738453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:26:08.738453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:26:08.738453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:26:08.738453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:26:08.738453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:26:08.738453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:26:08.738453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:26:08.738453 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:26:08.740100 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f027c3b75bc6430abd765a26269f9058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:26:08.740100 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:26:08.740100 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:26:08.740100 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:26:08.740100 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:26:08.740100 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:26:08.740100 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:26:08.740100 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: b1302d3b8649407ca010f12aad7a6597 May 27 15:26:08.740100 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:26:08.740100 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:26:08.740100 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance afe790e7-3765-4759-9108-4ce3101e56f9 could not be found. May 27 15:26:08.740100 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': 'afe790e7-3765-4759-9108-4ce3101e56f9'} May 27 15:26:08.744325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:26:08.744325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:08.744325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:26:08.744325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:26:08.744325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:26:08.744325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:26:08.744325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:26:08.744325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:26:08.744325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:26:08.744325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:26:08.744325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe790e7-3765-4759-9108-4ce3101e56f9 could not be found. May 27 15:26:08.744325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:26:08.744325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:08.744325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:26:08.744325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:08.744325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:08.744325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:08.744325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:26:08.744325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:26:08.744325 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:26:08.745870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:26:08.745870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:26:08.745870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:26:08.745870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:26:08.745870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:26:08.745870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:26:08.745870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:26:08.745870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe790e7-3765-4759-9108-4ce3101e56f9 could not be found. May 27 15:26:08.745870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:26:08.745870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:26:08.745870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:26:08.745870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:26:08.745870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:26:08.745870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:26:08.745870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:26:08.745870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:26:08.745870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe790e7-3765-4759-9108-4ce3101e56f9 could not be found. May 27 15:26:08.745870 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:26:08.747382 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-aeea708a-b9c2-4a9f-ac63-91385d915440 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Returning 404 to user: Instance afe790e7-3765-4759-9108-4ce3101e56f9 could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:26:08.747382 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-aeea708a-b9c2-4a9f-ac63-91385d915440 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9" status: 404 len: 111 microversion: 2.1 time: 0.030555 May 27 15:26:08.747382 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 555/1090] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:26:08 2022] GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:26:08.749453 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a73b4586-7fc3-45ed-af00-d4059161f584 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '.version_select at 0x7f57e21b1160>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:08.768202 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a73b4586-7fc3-45ed-af00-d4059161f584 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-789247466" status: 202 len: 0 microversion: 2.1 time: 0.022771 May 27 15:26:08.768805 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 536/1091] 10.222.0.50 () {58 vars in 1217 bytes} [Fri May 27 15:26:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-789247466 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:26:09.418400 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-5eb7e7d7-e04f-4d96-97e2-bbf40b669a31 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Action: 'create', calling method: .version_select at 0x7f57e170cd30>, body: {"keypair": {"name": "tempest-keypair-513640628", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAqVmS38HjjhOa4AxJPj3YNLos7wciG1kxLJxawE+xGAzm3NE/Azc7j8dCWEHSqRzYSQC8Bnlrgu2cRHWBqJQdNs2cOyF4rF/5GUlJd5qbo8wWF86CpOUvcmr+dvbjLag=="}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:09.435698 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-5eb7e7d7-e04f-4d96-97e2-bbf40b669a31 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Getting quotas for project f027c3b75bc6430abd765a26269f9058. Resources: {'key_pairs'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:26:09.439559 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.quota [None req-5eb7e7d7-e04f-4d96-97e2-bbf40b669a31 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Getting quotas for user b1302d3b8649407ca010f12aad7a6597 and project f027c3b75bc6430abd765a26269f9058. Resources: {'key_pairs'} {{(pid=117742) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:26:09.464381 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-5eb7e7d7-e04f-4d96-97e2-bbf40b669a31 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051325 May 27 15:26:09.465407 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 556/1092] 10.222.0.50 () {60 vars in 1158 bytes} [Fri May 27 15:26:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:26:10.707506 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-54d96ed7-4290-4cb3-8823-84afe044eb1f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1850318356", "imageRef": "a9407644-1f68-43e6-beb1-ce2085766180", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b7857e3-255b-417e-82ed-fcdb2806f57d"}], "security_groups": [{"name": "tempest-securitygroup--1994787079"}], "key_name": "tempest-keypair-513640628", "user_data": "}} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:10.810033 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.network.neutron [None req-54d96ed7-4290-4cb3-8823-84afe044eb1f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] validate_networks() for [('6b7857e3-255b-417e-82ed-fcdb2806f57d', None, None, None, None, None)] {{(pid=117743) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 15:26:11.171644 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-54d96ed7-4290-4cb3-8823-84afe044eb1f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Flavor limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 15:26:11.172075 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-54d96ed7-4290-4cb3-8823-84afe044eb1f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Image limits 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 15:26:11.172871 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-54d96ed7-4290-4cb3-8823-84afe044eb1f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Flavor pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 15:26:11.173358 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-54d96ed7-4290-4cb3-8823-84afe044eb1f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Image pref 0:0:0 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 15:26:11.173776 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.virt.hardware [None req-54d96ed7-4290-4cb3-8823-84afe044eb1f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117743) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 15:26:11.182547 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-54d96ed7-4290-4cb3-8823-84afe044eb1f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:11.183034 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-54d96ed7-4290-4cb3-8823-84afe044eb1f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:11.183837 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-54d96ed7-4290-4cb3-8823-84afe044eb1f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:11.184275 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-54d96ed7-4290-4cb3-8823-84afe044eb1f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:11.201416 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-54d96ed7-4290-4cb3-8823-84afe044eb1f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Getting quotas for project f027c3b75bc6430abd765a26269f9058. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 15:26:11.205909 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.quota [None req-54d96ed7-4290-4cb3-8823-84afe044eb1f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Getting quotas for user b1302d3b8649407ca010f12aad7a6597 and project f027c3b75bc6430abd765a26269f9058. Resources: {'cores', 'ram', 'instances'} {{(pid=117743) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 15:26:11.216736 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-54d96ed7-4290-4cb3-8823-84afe044eb1f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Going to run 1 instances... {{(pid=117743) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 15:26:11.219182 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-54d96ed7-4290-4cb3-8823-84afe044eb1f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a9407644-1f68-43e6-beb1-ce2085766180',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117743) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 15:26:11.264855 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-54d96ed7-4290-4cb3-8823-84afe044eb1f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.561580 May 27 15:26:11.265548 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 537/1093] 10.222.0.50 () {60 vars in 1146 bytes} [Fri May 27 15:26:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 15:26:11.276379 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-129583f3-d392-4864-87f4-b0b0731a2ef0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:11.277102 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-129583f3-d392-4864-87f4-b0b0731a2ef0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:11.333440 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-129583f3-d392-4864-87f4-b0b0731a2ef0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:11.340292 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-129583f3-d392-4864-87f4-b0b0731a2ef0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661" status: 200 len: 1241 microversion: 2.1 time: 0.067961 May 27 15:26:11.340883 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 557/1094] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:26:11 2022] GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:12.357891 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-dccbc40e-e3f1-4ceb-92eb-f5cfa4764940 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:12.358518 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-dccbc40e-e3f1-4ceb-92eb-f5cfa4764940 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:12.366912 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-dccbc40e-e3f1-4ceb-92eb-f5cfa4764940 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:12.367376 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-dccbc40e-e3f1-4ceb-92eb-f5cfa4764940 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:12.368158 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-dccbc40e-e3f1-4ceb-92eb-f5cfa4764940 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:12.368600 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-dccbc40e-e3f1-4ceb-92eb-f5cfa4764940 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:12.440660 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-dccbc40e-e3f1-4ceb-92eb-f5cfa4764940 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:12.448192 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-dccbc40e-e3f1-4ceb-92eb-f5cfa4764940 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661" status: 200 len: 1311 microversion: 2.1 time: 0.094419 May 27 15:26:12.449209 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 538/1095] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:26:12 2022] GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661 => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:13.465790 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-aee62a82-c0e4-4284-82d3-41da9d4cc0a1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:13.466448 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-aee62a82-c0e4-4284-82d3-41da9d4cc0a1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:13.473648 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-aee62a82-c0e4-4284-82d3-41da9d4cc0a1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:13.474104 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-aee62a82-c0e4-4284-82d3-41da9d4cc0a1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:13.474915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-aee62a82-c0e4-4284-82d3-41da9d4cc0a1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:13.475475 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-aee62a82-c0e4-4284-82d3-41da9d4cc0a1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:13.627464 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-aee62a82-c0e4-4284-82d3-41da9d4cc0a1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:13.635153 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-aee62a82-c0e4-4284-82d3-41da9d4cc0a1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661" status: 200 len: 1367 microversion: 2.1 time: 0.173435 May 27 15:26:13.635745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 558/1096] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:26:13 2022] GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:13.882595 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [req-fa2e3cc8-1df0-4d70-9f62-f273b6e66886 req-537fbe37-3f1b-4603-8381-e91d66aea477 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6361d0fe-dac5-4b58-820a-0cdcf8b90661", "tag": "813d09f3-7ab3-4c07-835c-8a4ad479b4ce"}]} {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:13.893877 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-fa2e3cc8-1df0-4d70-9f62-f273b6e66886 req-537fbe37-3f1b-4603-8381-e91d66aea477 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:13.894196 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [req-fa2e3cc8-1df0-4d70-9f62-f273b6e66886 req-537fbe37-3f1b-4603-8381-e91d66aea477 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:13.907449 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.compute.server_external_events [req-fa2e3cc8-1df0-4d70-9f62-f273b6e66886 req-537fbe37-3f1b-4603-8381-e91d66aea477 service nova] Creating event network-changed:813d09f3-7ab3-4c07-835c-8a4ad479b4ce for instance 6361d0fe-dac5-4b58-820a-0cdcf8b90661 on hv-cinder-84254 May 27 15:26:13.921027 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [req-fa2e3cc8-1df0-4d70-9f62-f273b6e66886 req-537fbe37-3f1b-4603-8381-e91d66aea477 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042887 May 27 15:26:13.921698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 539/1097] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:26:14.654020 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-1ba0a2a6-2b8c-4119-88f1-3eb0d9bba8f2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:14.654572 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-1ba0a2a6-2b8c-4119-88f1-3eb0d9bba8f2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:14.661749 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1ba0a2a6-2b8c-4119-88f1-3eb0d9bba8f2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:14.662196 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1ba0a2a6-2b8c-4119-88f1-3eb0d9bba8f2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:14.662980 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1ba0a2a6-2b8c-4119-88f1-3eb0d9bba8f2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:14.663444 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-1ba0a2a6-2b8c-4119-88f1-3eb0d9bba8f2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:14.796467 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-1ba0a2a6-2b8c-4119-88f1-3eb0d9bba8f2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:14.804309 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-1ba0a2a6-2b8c-4119-88f1-3eb0d9bba8f2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661" status: 200 len: 1367 microversion: 2.1 time: 0.154520 May 27 15:26:14.806195 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 559/1098] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:26:14 2022] GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:15.822870 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-804974b4-6052-4fde-bb0e-ed5e6fb67f4c tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:15.823594 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-804974b4-6052-4fde-bb0e-ed5e6fb67f4c tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:15.829988 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-804974b4-6052-4fde-bb0e-ed5e6fb67f4c tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:15.830447 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-804974b4-6052-4fde-bb0e-ed5e6fb67f4c tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:15.831255 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-804974b4-6052-4fde-bb0e-ed5e6fb67f4c tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:15.831696 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-804974b4-6052-4fde-bb0e-ed5e6fb67f4c tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:15.962600 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-804974b4-6052-4fde-bb0e-ed5e6fb67f4c tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:15.971100 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-804974b4-6052-4fde-bb0e-ed5e6fb67f4c tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661" status: 200 len: 1367 microversion: 2.1 time: 0.152963 May 27 15:26:15.971683 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 540/1099] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:26:15 2022] GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:16.989359 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-2ac0a268-9099-4b71-9496-6759dcbf6b6b tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:16.989961 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-2ac0a268-9099-4b71-9496-6759dcbf6b6b tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:16.996456 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2ac0a268-9099-4b71-9496-6759dcbf6b6b tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:16.996898 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2ac0a268-9099-4b71-9496-6759dcbf6b6b tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:16.997650 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2ac0a268-9099-4b71-9496-6759dcbf6b6b tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:16.998075 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-2ac0a268-9099-4b71-9496-6759dcbf6b6b tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:17.131357 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-2ac0a268-9099-4b71-9496-6759dcbf6b6b tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:17.138927 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-2ac0a268-9099-4b71-9496-6759dcbf6b6b tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661" status: 200 len: 1367 microversion: 2.1 time: 0.154745 May 27 15:26:17.139507 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 560/1100] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:26:16 2022] GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:18.159736 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-80de1753-4c8e-4a5c-a153-3466e92aecd4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:18.160367 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-80de1753-4c8e-4a5c-a153-3466e92aecd4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:18.168646 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-80de1753-4c8e-4a5c-a153-3466e92aecd4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:18.169100 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-80de1753-4c8e-4a5c-a153-3466e92aecd4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:18.169882 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-80de1753-4c8e-4a5c-a153-3466e92aecd4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:18.170321 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-80de1753-4c8e-4a5c-a153-3466e92aecd4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:18.305308 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-80de1753-4c8e-4a5c-a153-3466e92aecd4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:18.313378 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-80de1753-4c8e-4a5c-a153-3466e92aecd4 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661" status: 200 len: 1367 microversion: 2.1 time: 0.159483 May 27 15:26:18.313966 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 541/1101] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:26:18 2022] GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:19.035224 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-128ec4c2-1656-44fe-a1f3-3e13237a9f50 req-f4ca4303-0b2f-4b5f-8707-db4ff251ca29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6361d0fe-dac5-4b58-820a-0cdcf8b90661", "name": "network-vif-plugged", "status": "completed", "tag": "813d09f3-7ab3-4c07-835c-8a4ad479b4ce"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:19.044058 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-128ec4c2-1656-44fe-a1f3-3e13237a9f50 req-f4ca4303-0b2f-4b5f-8707-db4ff251ca29 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:19.044594 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-128ec4c2-1656-44fe-a1f3-3e13237a9f50 req-f4ca4303-0b2f-4b5f-8707-db4ff251ca29 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:19.056041 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-128ec4c2-1656-44fe-a1f3-3e13237a9f50 req-f4ca4303-0b2f-4b5f-8707-db4ff251ca29 service nova] Creating event network-vif-plugged:813d09f3-7ab3-4c07-835c-8a4ad479b4ce for instance 6361d0fe-dac5-4b58-820a-0cdcf8b90661 on hv-cinder-84254 May 27 15:26:19.061189 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-128ec4c2-1656-44fe-a1f3-3e13237a9f50 req-f4ca4303-0b2f-4b5f-8707-db4ff251ca29 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087057 May 27 15:26:19.061822 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 561/1102] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:26:19.331559 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-6db1a2d5-70cc-4a3a-82e7-2ef7f2fe805e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:19.332267 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-6db1a2d5-70cc-4a3a-82e7-2ef7f2fe805e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:19.339034 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6db1a2d5-70cc-4a3a-82e7-2ef7f2fe805e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:19.339482 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6db1a2d5-70cc-4a3a-82e7-2ef7f2fe805e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:19.340283 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6db1a2d5-70cc-4a3a-82e7-2ef7f2fe805e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:19.340714 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-6db1a2d5-70cc-4a3a-82e7-2ef7f2fe805e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:19.473600 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-6db1a2d5-70cc-4a3a-82e7-2ef7f2fe805e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:19.481363 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-6db1a2d5-70cc-4a3a-82e7-2ef7f2fe805e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661" status: 200 len: 1367 microversion: 2.1 time: 0.154569 May 27 15:26:19.481938 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 542/1103] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:26:19 2022] GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:20.498702 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-317a1d9f-e5a9-44a3-b148-2605634aba9f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:20.499563 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-317a1d9f-e5a9-44a3-b148-2605634aba9f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:20.508416 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-317a1d9f-e5a9-44a3-b148-2605634aba9f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:20.509124 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-317a1d9f-e5a9-44a3-b148-2605634aba9f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:20.510221 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-317a1d9f-e5a9-44a3-b148-2605634aba9f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:20.511076 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-317a1d9f-e5a9-44a3-b148-2605634aba9f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:20.646255 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-317a1d9f-e5a9-44a3-b148-2605634aba9f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:26:20.653734 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-317a1d9f-e5a9-44a3-b148-2605634aba9f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661" status: 200 len: 1555 microversion: 2.1 time: 0.159883 May 27 15:26:20.654304 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 562/1104] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:26:20 2022] GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:26:20.670656 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-5b94ce8c-f11f-4b9e-b70f-f8ab3b916829 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:20.671187 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-5b94ce8c-f11f-4b9e-b70f-f8ab3b916829 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:20.677180 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5b94ce8c-f11f-4b9e-b70f-f8ab3b916829 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:20.677631 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5b94ce8c-f11f-4b9e-b70f-f8ab3b916829 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:20.678384 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5b94ce8c-f11f-4b9e-b70f-f8ab3b916829 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:20.678817 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5b94ce8c-f11f-4b9e-b70f-f8ab3b916829 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:20.755196 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-5b94ce8c-f11f-4b9e-b70f-f8ab3b916829 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088477 May 27 15:26:20.755788 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 543/1105] 10.222.0.50 () {58 vars in 1274 bytes} [Fri May 27 15:26:20 2022] GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:26:21.936283 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-68dd8307-7c80-469b-a101-c9193b6eac53 req-8722b332-1990-4850-9618-6b77bcaf62d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6361d0fe-dac5-4b58-820a-0cdcf8b90661", "tag": "813d09f3-7ab3-4c07-835c-8a4ad479b4ce"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:21.940431 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell0:SELECT=6 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:21.947107 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-68dd8307-7c80-469b-a101-c9193b6eac53 req-8722b332-1990-4850-9618-6b77bcaf62d4 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:21.947552 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-68dd8307-7c80-469b-a101-c9193b6eac53 req-8722b332-1990-4850-9618-6b77bcaf62d4 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:21.959260 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-68dd8307-7c80-469b-a101-c9193b6eac53 req-8722b332-1990-4850-9618-6b77bcaf62d4 service nova] Creating event network-changed:813d09f3-7ab3-4c07-835c-8a4ad479b4ce for instance 6361d0fe-dac5-4b58-820a-0cdcf8b90661 on hv-cinder-84254 May 27 15:26:21.964455 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-68dd8307-7c80-469b-a101-c9193b6eac53 req-8722b332-1990-4850-9618-6b77bcaf62d4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031832 May 27 15:26:21.965181 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 563/1106] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:26:58.055456 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=2 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:58.056230 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell0:SELECT=6 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:58.057612 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:58.058309 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG dbcounter [-] [117743] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117743) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:58.063137 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-b0de0fb2-8a54-4ae1-bf94-bfec68d39477 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:26:58.063636 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-b0de0fb2-8a54-4ae1-bf94-bfec68d39477 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:58.072340 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b0de0fb2-8a54-4ae1-bf94-bfec68d39477 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:58.072888 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b0de0fb2-8a54-4ae1-bf94-bfec68d39477 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:58.073662 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b0de0fb2-8a54-4ae1-bf94-bfec68d39477 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:58.074104 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-b0de0fb2-8a54-4ae1-bf94-bfec68d39477 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:58.100759 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-b0de0fb2-8a54-4ae1-bf94-bfec68d39477 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661/ips" status: 200 len: 148 microversion: 2.1 time: 0.046094 May 27 15:26:58.101345 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 544/1107] 10.222.0.50 () {58 vars in 1247 bytes} [Fri May 27 15:26:58 2022] GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661/ips => generated 148 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:26:59.432861 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:59.433653 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG dbcounter [-] [117742] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117742) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 15:26:59.438881 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-704ca6cf-b029-4e0e-92c1-7f33b61ba23f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c834a80-1a37-4f62-ae03-af422fc9a428"}} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:26:59.440057 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-704ca6cf-b029-4e0e-92c1-7f33b61ba23f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:26:59.448014 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-704ca6cf-b029-4e0e-92c1-7f33b61ba23f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:59.448497 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-704ca6cf-b029-4e0e-92c1-7f33b61ba23f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:59.449284 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-704ca6cf-b029-4e0e-92c1-7f33b61ba23f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:26:59.449724 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-704ca6cf-b029-4e0e-92c1-7f33b61ba23f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:26:59.715673 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-704ca6cf-b029-4e0e-92c1-7f33b61ba23f tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "POST /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284255 May 27 15:26:59.716301 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 564/1108] 10.222.0.50 () {60 vars in 1322 bytes} [Fri May 27 15:26:59 2022] POST /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:27:07.333668 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-78348f7e-9cc6-4e5a-b196-cb66adabaf27 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:07.334232 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-78348f7e-9cc6-4e5a-b196-cb66adabaf27 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:07.340982 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-78348f7e-9cc6-4e5a-b196-cb66adabaf27 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:07.341498 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-78348f7e-9cc6-4e5a-b196-cb66adabaf27 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:07.342949 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-78348f7e-9cc6-4e5a-b196-cb66adabaf27 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:07.343425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-78348f7e-9cc6-4e5a-b196-cb66adabaf27 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:07.425892 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.objects.instance [None req-78348f7e-9cc6-4e5a-b196-cb66adabaf27 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lazy-loading 'services' on Instance uuid 6361d0fe-dac5-4b58-820a-0cdcf8b90661 {{(pid=117743) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 15:27:07.499860 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-78348f7e-9cc6-4e5a-b196-cb66adabaf27 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661/os-volume_attachments/8c834a80-1a37-4f62-ae03-af422fc9a428" status: 202 len: 0 microversion: 2.1 time: 0.169913 May 27 15:27:07.500458 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 545/1109] 10.222.0.50 () {58 vars in 1415 bytes} [Fri May 27 15:27:07 2022] DELETE /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661/os-volume_attachments/8c834a80-1a37-4f62-ae03-af422fc9a428 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 15:27:07.509875 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-3d0fd389-8b45-4bb1-ac7a-5a773b6bbfcc tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:07.511003 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-3d0fd389-8b45-4bb1-ac7a-5a773b6bbfcc tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:07.518114 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3d0fd389-8b45-4bb1-ac7a-5a773b6bbfcc tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:07.518558 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3d0fd389-8b45-4bb1-ac7a-5a773b6bbfcc tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:07.519438 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3d0fd389-8b45-4bb1-ac7a-5a773b6bbfcc tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:07.519959 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-3d0fd389-8b45-4bb1-ac7a-5a773b6bbfcc tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:07.553869 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-3d0fd389-8b45-4bb1-ac7a-5a773b6bbfcc tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048836 May 27 15:27:07.554465 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 565/1110] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 15:27:07 2022] GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:27:08.567405 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d945a285-64a9-467a-bf25-bfbb5b704d5e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:08.568386 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-d945a285-64a9-467a-bf25-bfbb5b704d5e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:08.574772 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d945a285-64a9-467a-bf25-bfbb5b704d5e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:08.575275 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d945a285-64a9-467a-bf25-bfbb5b704d5e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:08.576035 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d945a285-64a9-467a-bf25-bfbb5b704d5e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:08.576469 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d945a285-64a9-467a-bf25-bfbb5b704d5e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:08.605425 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-d945a285-64a9-467a-bf25-bfbb5b704d5e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042892 May 27 15:27:08.605983 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 546/1111] 10.222.0.50 () {58 vars in 1301 bytes} [Fri May 27 15:27:08 2022] GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 15:27:08.665299 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-20f39e93-0cc2-4f3f-9c48-2fb9cfabd53d tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:08.665846 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-20f39e93-0cc2-4f3f-9c48-2fb9cfabd53d tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:08.672881 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-20f39e93-0cc2-4f3f-9c48-2fb9cfabd53d tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:08.673334 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-20f39e93-0cc2-4f3f-9c48-2fb9cfabd53d tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:08.674096 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-20f39e93-0cc2-4f3f-9c48-2fb9cfabd53d tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:08.674532 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-20f39e93-0cc2-4f3f-9c48-2fb9cfabd53d tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:08.700428 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-20f39e93-0cc2-4f3f-9c48-2fb9cfabd53d tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] Going to try to terminate instance {{(pid=117742) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 15:27:08.777363 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-20f39e93-0cc2-4f3f-9c48-2fb9cfabd53d tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661" status: 204 len: 0 microversion: 2.1 time: 0.115523 May 27 15:27:08.777969 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 566/1112] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:27:08 2022] DELETE /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 15:27:08.787214 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-a4e7cb7a-1cdb-48f1-9180-4ed1d94ba7b0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:08.788362 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-a4e7cb7a-1cdb-48f1-9180-4ed1d94ba7b0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:08.799013 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a4e7cb7a-1cdb-48f1-9180-4ed1d94ba7b0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:08.799458 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a4e7cb7a-1cdb-48f1-9180-4ed1d94ba7b0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:08.801124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a4e7cb7a-1cdb-48f1-9180-4ed1d94ba7b0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:08.801567 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-a4e7cb7a-1cdb-48f1-9180-4ed1d94ba7b0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:08.939333 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-a4e7cb7a-1cdb-48f1-9180-4ed1d94ba7b0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:08.946921 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-a4e7cb7a-1cdb-48f1-9180-4ed1d94ba7b0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661" status: 200 len: 1680 microversion: 2.1 time: 0.164304 May 27 15:27:08.947488 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 547/1113] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:27:08 2022] GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:09.964681 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-8bac3e4f-3be4-40fb-ae11-bbfca569a28e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:09.965369 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-8bac3e4f-3be4-40fb-ae11-bbfca569a28e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:09.972560 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8bac3e4f-3be4-40fb-ae11-bbfca569a28e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:09.973002 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8bac3e4f-3be4-40fb-ae11-bbfca569a28e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:09.973753 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8bac3e4f-3be4-40fb-ae11-bbfca569a28e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:09.974179 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-8bac3e4f-3be4-40fb-ae11-bbfca569a28e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:10.105947 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.policy [None req-8bac3e4f-3be4-40fb-ae11-bbfca569a28e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117742) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:10.116635 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-8bac3e4f-3be4-40fb-ae11-bbfca569a28e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661" status: 200 len: 1680 microversion: 2.1 time: 0.156164 May 27 15:27:10.117225 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 567/1114] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:27:09 2022] GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 15:27:11.136122 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-ad0fa089-1a95-44b2-9726-4b4c2641f794 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:11.136668 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-ad0fa089-1a95-44b2-9726-4b4c2641f794 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:11.143538 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ad0fa089-1a95-44b2-9726-4b4c2641f794 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:11.143989 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ad0fa089-1a95-44b2-9726-4b4c2641f794 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:11.144763 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ad0fa089-1a95-44b2-9726-4b4c2641f794 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:11.145204 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-ad0fa089-1a95-44b2-9726-4b4c2641f794 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:11.281427 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.policy [None req-ad0fa089-1a95-44b2-9726-4b4c2641f794 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1302d3b8649407ca010f12aad7a6597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f027c3b75bc6430abd765a26269f9058', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117743) authorize /opt/stack/nova/nova/policy.py:199}} May 27 15:27:11.289168 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-ad0fa089-1a95-44b2-9726-4b4c2641f794 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661" status: 200 len: 1680 microversion: 2.1 time: 0.157091 May 27 15:27:11.289823 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 548/1115] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:27:11 2022] GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 15:27:11.649533 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [req-cb66400a-90d5-420f-9d84-f4568bc6010c req-670ea424-ca55-4089-a69b-944e3b9283b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6361d0fe-dac5-4b58-820a-0cdcf8b90661", "name": "network-vif-deleted", "tag": "813d09f3-7ab3-4c07-835c-8a4ad479b4ce"}]} {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 15:27:11.659592 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-cb66400a-90d5-420f-9d84-f4568bc6010c req-670ea424-ca55-4089-a69b-944e3b9283b3 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:11.660800 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [req-cb66400a-90d5-420f-9d84-f4568bc6010c req-670ea424-ca55-4089-a69b-944e3b9283b3 service nova] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:11.673395 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.compute.server_external_events [req-cb66400a-90d5-420f-9d84-f4568bc6010c req-670ea424-ca55-4089-a69b-944e3b9283b3 service nova] Creating event network-vif-deleted:813d09f3-7ab3-4c07-835c-8a4ad479b4ce for instance 6361d0fe-dac5-4b58-820a-0cdcf8b90661 on hv-cinder-84254 May 27 15:27:11.678489 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [req-cb66400a-90d5-420f-9d84-f4568bc6010c req-670ea424-ca55-4089-a69b-944e3b9283b3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032716 May 27 15:27:11.679229 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 568/1116] 10.222.0.50 () {64 vars in 1317 bytes} [Fri May 27 15:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 15:27:12.307163 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-8daf005a-a951-47bf-88b0-23fa03178df0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:12.307903 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-8daf005a-a951-47bf-88b0-23fa03178df0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:12.316025 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8daf005a-a951-47bf-88b0-23fa03178df0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:12.316525 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8daf005a-a951-47bf-88b0-23fa03178df0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:12.317374 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8daf005a-a951-47bf-88b0-23fa03178df0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:12.317877 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-8daf005a-a951-47bf-88b0-23fa03178df0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:12.331916 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-8daf005a-a951-47bf-88b0-23fa03178df0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] HTTP exception thrown: Instance 6361d0fe-dac5-4b58-820a-0cdcf8b90661 could not be found. May 27 15:27:12.333684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-8daf005a-a951-47bf-88b0-23fa03178df0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Request method failure captured: May 27 15:27:12.333684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661 HTTP/1.1 May 27 15:27:12.333684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:27:12.333684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:27:12.333684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:27:12.333684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 0 May 27 15:27:12.333684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:27:12.333684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:27:12.333684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:27:12.333684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:27:12.333684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOzNSb8dAVARh41NDH1neBeIQ7mEiYGzluZ1aLHWr-bZMM8Yk3DEMls-W331t4g56BKuQBAiw5JIF3Yut9sBSPvmBYrZo49s8qFM14ylIEBI_1nGqB4zBnvHBSyTSPec4EhH5fjot66Y9DnhxIGyrqIMzSWHLKve581Z3mM8_f45p1g May 27 15:27:12.333684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:27:12.333684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:27:12.333684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:27:12.333684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:27:12.333684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:27:12.333684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:27:12.333684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:27:12.333684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:12.333684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:27:12.333684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:27:12.335165 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f027c3b75bc6430abd765a26269f9058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:27:12.335165 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:12.335165 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:27:12.335165 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:12.335165 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:27:12.335165 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:27:12.335165 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:27:12.335165 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: b1302d3b8649407ca010f12aad7a6597 May 27 15:27:12.335165 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:27:12.335165 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: > May 27 15:27:12.335165 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Instance 6361d0fe-dac5-4b58-820a-0cdcf8b90661 could not be found. May 27 15:27:12.335165 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'id': '6361d0fe-dac5-4b58-820a-0cdcf8b90661'} May 27 15:27:12.336037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:27:12.336037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:12.336037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:27:12.336037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:27:12.336037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:27:12.336037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:27:12.336037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:27:12.336037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:27:12.336037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:27:12.336037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:27:12.336037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6361d0fe-dac5-4b58-820a-0cdcf8b90661 could not be found. May 27 15:27:12.336037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:12.336037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:12.336037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:12.336037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:12.336037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:12.336037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:12.336037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:27:12.336037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:27:12.336037 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:27:12.337667 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:27:12.337667 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:27:12.337667 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:27:12.337667 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:27:12.337667 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:27:12.337667 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:27:12.337667 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:27:12.337667 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6361d0fe-dac5-4b58-820a-0cdcf8b90661 could not be found. May 27 15:27:12.337667 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:12.337667 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:12.337667 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:12.337667 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:12.337667 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:12.337667 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:12.337667 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:27:12.337667 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:27:12.337667 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6361d0fe-dac5-4b58-820a-0cdcf8b90661 could not be found. May 27 15:27:12.337667 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:12.339407 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-8daf005a-a951-47bf-88b0-23fa03178df0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Returning 404 to user: Instance 6361d0fe-dac5-4b58-820a-0cdcf8b90661 could not be found. {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:27:12.339407 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-8daf005a-a951-47bf-88b0-23fa03178df0 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661" status: 404 len: 111 microversion: 2.1 time: 0.031973 May 27 15:27:12.339407 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 549/1117] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:27:12 2022] GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:27:12.344818 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-a2569cbd-c906-44e1-95e1-ae26ab978a37 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '.version_select at 0x7f57e18b6ca0>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:12.363025 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-a2569cbd-c906-44e1-95e1-ae26ab978a37 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-513640628" status: 202 len: 0 microversion: 2.1 time: 0.022591 May 27 15:27:12.363764 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 569/1118] 10.222.0.50 () {58 vars in 1217 bytes} [Fri May 27 15:27:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-513640628 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 15:27:14.130719 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-cca10973-5ac1-463b-81dc-af96b1f6f263 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:14.131276 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-cca10973-5ac1-463b-81dc-af96b1f6f263 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:14.137736 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-cca10973-5ac1-463b-81dc-af96b1f6f263 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:14.138187 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-cca10973-5ac1-463b-81dc-af96b1f6f263 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:14.139522 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-cca10973-5ac1-463b-81dc-af96b1f6f263 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:14.140031 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-cca10973-5ac1-463b-81dc-af96b1f6f263 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:14.153275 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-cca10973-5ac1-463b-81dc-af96b1f6f263 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] HTTP exception thrown: Instance 6361d0fe-dac5-4b58-820a-0cdcf8b90661 could not be found. May 27 15:27:14.155009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-cca10973-5ac1-463b-81dc-af96b1f6f263 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Request method failure captured: May 27 15:27:14.155009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: DELETE /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661 HTTP/1.1 May 27 15:27:14.155009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:27:14.155009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:27:14.155009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:27:14.155009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 0 May 27 15:27:14.155009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:27:14.155009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:27:14.155009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:27:14.155009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:27:14.155009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOzNSb8dAVARh41NDH1neBeIQ7mEiYGzluZ1aLHWr-bZMM8Yk3DEMls-W331t4g56BKuQBAiw5JIF3Yut9sBSPvmBYrZo49s8qFM14ylIEBI_1nGqB4zBnvHBSyTSPec4EhH5fjot66Y9DnhxIGyrqIMzSWHLKve581Z3mM8_f45p1g May 27 15:27:14.155009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:27:14.155009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:27:14.155009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:27:14.155009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:27:14.155009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:27:14.155009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:27:14.155009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:27:14.155009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:14.155009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:27:14.155009 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:27:14.156666 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f027c3b75bc6430abd765a26269f9058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:27:14.156666 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:14.156666 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:27:14.156666 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:14.156666 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:27:14.156666 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:27:14.156666 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:27:14.156666 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: b1302d3b8649407ca010f12aad7a6597 May 27 15:27:14.156666 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:27:14.156666 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: > May 27 15:27:14.156666 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Instance 6361d0fe-dac5-4b58-820a-0cdcf8b90661 could not be found. May 27 15:27:14.156666 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'id': '6361d0fe-dac5-4b58-820a-0cdcf8b90661'} May 27 15:27:14.159124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:27:14.159124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:14.159124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:27:14.159124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:27:14.159124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:27:14.159124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:27:14.159124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:27:14.159124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:27:14.159124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:27:14.159124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:27:14.159124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6361d0fe-dac5-4b58-820a-0cdcf8b90661 could not be found. May 27 15:27:14.159124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:14.159124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:14.159124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:14.159124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:14.159124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:14.159124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:14.159124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:27:14.159124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:27:14.159124 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:27:14.160615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:27:14.160615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:27:14.160615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:27:14.160615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:27:14.160615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:27:14.160615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:27:14.160615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:27:14.160615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:27:14.160615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:27:14.160615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6361d0fe-dac5-4b58-820a-0cdcf8b90661 could not be found. May 27 15:27:14.160615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:14.160615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:14.160615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:14.160615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:14.160615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:14.160615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:14.160615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:27:14.160615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:27:14.160615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6361d0fe-dac5-4b58-820a-0cdcf8b90661 could not be found. May 27 15:27:14.160615 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:14.162151 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-cca10973-5ac1-463b-81dc-af96b1f6f263 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Returning 404 to user: Instance 6361d0fe-dac5-4b58-820a-0cdcf8b90661 could not be found. {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:27:14.162151 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-cca10973-5ac1-463b-81dc-af96b1f6f263 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661" status: 404 len: 111 microversion: 2.1 time: 0.029557 May 27 15:27:14.162151 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 550/1119] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:27:14 2022] DELETE /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:27:14.165280 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-4cd2358d-bce5-41c9-9968-90369a510e83 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:14.166014 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-4cd2358d-bce5-41c9-9968-90369a510e83 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 6361d0fe-dac5-4b58-820a-0cdcf8b90661] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:14.172421 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4cd2358d-bce5-41c9-9968-90369a510e83 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:14.172872 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4cd2358d-bce5-41c9-9968-90369a510e83 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:14.173644 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4cd2358d-bce5-41c9-9968-90369a510e83 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:14.174112 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-4cd2358d-bce5-41c9-9968-90369a510e83 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:14.188169 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-4cd2358d-bce5-41c9-9968-90369a510e83 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] HTTP exception thrown: Instance 6361d0fe-dac5-4b58-820a-0cdcf8b90661 could not be found. May 27 15:27:14.189776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-4cd2358d-bce5-41c9-9968-90369a510e83 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Request method failure captured: May 27 15:27:14.189776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661 HTTP/1.1 May 27 15:27:14.189776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:27:14.189776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:27:14.189776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:27:14.189776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:27:14.189776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:27:14.189776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:27:14.189776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:27:14.189776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:27:14.189776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOzNSb8dAVARh41NDH1neBeIQ7mEiYGzluZ1aLHWr-bZMM8Yk3DEMls-W331t4g56BKuQBAiw5JIF3Yut9sBSPvmBYrZo49s8qFM14ylIEBI_1nGqB4zBnvHBSyTSPec4EhH5fjot66Y9DnhxIGyrqIMzSWHLKve581Z3mM8_f45p1g May 27 15:27:14.189776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:27:14.189776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:27:14.189776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:27:14.189776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:27:14.189776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:27:14.189776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:27:14.189776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:27:14.189776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:14.189776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:27:14.189776 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:27:14.191351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f027c3b75bc6430abd765a26269f9058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:27:14.191351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:14.191351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:27:14.191351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:14.191351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:27:14.191351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:27:14.191351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:27:14.191351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: b1302d3b8649407ca010f12aad7a6597 May 27 15:27:14.191351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:27:14.191351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:27:14.191351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance 6361d0fe-dac5-4b58-820a-0cdcf8b90661 could not be found. May 27 15:27:14.191351 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': '6361d0fe-dac5-4b58-820a-0cdcf8b90661'} May 27 15:27:14.192272 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:27:14.192272 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:14.192272 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:27:14.192272 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:27:14.192272 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:27:14.192272 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:27:14.192272 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:27:14.192272 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:27:14.192272 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:27:14.192272 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:27:14.192272 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6361d0fe-dac5-4b58-820a-0cdcf8b90661 could not be found. May 27 15:27:14.192272 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:27:14.192272 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:14.192272 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:27:14.192272 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:14.192272 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:14.192272 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:14.192272 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:27:14.192272 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:27:14.192272 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:27:14.193598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:27:14.193598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:27:14.193598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:27:14.193598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:27:14.193598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:27:14.193598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:27:14.193598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:27:14.193598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6361d0fe-dac5-4b58-820a-0cdcf8b90661 could not be found. May 27 15:27:14.193598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:27:14.193598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:14.193598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:27:14.193598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:14.193598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:14.193598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:14.193598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:27:14.193598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:27:14.193598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6361d0fe-dac5-4b58-820a-0cdcf8b90661 could not be found. May 27 15:27:14.193598 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:27:14.194794 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-4cd2358d-bce5-41c9-9968-90369a510e83 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Returning 404 to user: Instance 6361d0fe-dac5-4b58-820a-0cdcf8b90661 could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:27:14.194794 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-4cd2358d-bce5-41c9-9968-90369a510e83 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661" status: 404 len: 111 microversion: 2.1 time: 0.030226 May 27 15:27:14.194794 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 570/1120] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:27:14 2022] GET /compute/v2.1/servers/6361d0fe-dac5-4b58-820a-0cdcf8b90661 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:27:15.324680 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-5e5da191-cfd3-414a-b50c-160e239a2af1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:15.325180 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-5e5da191-cfd3-414a-b50c-160e239a2af1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:15.332358 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5e5da191-cfd3-414a-b50c-160e239a2af1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:15.332838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5e5da191-cfd3-414a-b50c-160e239a2af1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:15.333672 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5e5da191-cfd3-414a-b50c-160e239a2af1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:15.334137 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-5e5da191-cfd3-414a-b50c-160e239a2af1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:15.348309 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-5e5da191-cfd3-414a-b50c-160e239a2af1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] HTTP exception thrown: Instance afe790e7-3765-4759-9108-4ce3101e56f9 could not be found. May 27 15:27:15.350038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-5e5da191-cfd3-414a-b50c-160e239a2af1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Request method failure captured: May 27 15:27:15.350038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: DELETE /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9 HTTP/1.1 May 27 15:27:15.350038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:27:15.350038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:27:15.350038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:27:15.350038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 0 May 27 15:27:15.350038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:27:15.350038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:27:15.350038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:27:15.350038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:27:15.350038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOzNSb8dAVARh41NDH1neBeIQ7mEiYGzluZ1aLHWr-bZMM8Yk3DEMls-W331t4g56BKuQBAiw5JIF3Yut9sBSPvmBYrZo49s8qFM14ylIEBI_1nGqB4zBnvHBSyTSPec4EhH5fjot66Y9DnhxIGyrqIMzSWHLKve581Z3mM8_f45p1g May 27 15:27:15.350038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:27:15.350038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:27:15.350038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:27:15.350038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:27:15.350038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:27:15.350038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:27:15.350038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:27:15.350038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:15.350038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:27:15.350038 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:27:15.351644 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f027c3b75bc6430abd765a26269f9058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:27:15.351644 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:15.351644 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:27:15.351644 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:15.351644 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:27:15.351644 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:27:15.351644 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:27:15.351644 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: b1302d3b8649407ca010f12aad7a6597 May 27 15:27:15.351644 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:27:15.351644 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: > May 27 15:27:15.351644 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Instance afe790e7-3765-4759-9108-4ce3101e56f9 could not be found. May 27 15:27:15.351644 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'id': 'afe790e7-3765-4759-9108-4ce3101e56f9'} May 27 15:27:15.352820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:27:15.352820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:15.352820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:27:15.352820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:27:15.352820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:27:15.352820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:27:15.352820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:27:15.352820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:27:15.352820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:27:15.352820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:27:15.352820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe790e7-3765-4759-9108-4ce3101e56f9 could not be found. May 27 15:27:15.352820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:15.352820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:15.352820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:15.352820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:15.352820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:15.352820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:15.352820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:27:15.352820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:27:15.352820 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:27:15.354190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:27:15.354190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:27:15.354190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:27:15.354190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:27:15.354190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:27:15.354190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:27:15.354190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:27:15.354190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:27:15.354190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:27:15.354190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe790e7-3765-4759-9108-4ce3101e56f9 could not be found. May 27 15:27:15.354190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:15.354190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:15.354190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:15.354190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:15.354190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:15.354190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:15.354190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:27:15.354190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:27:15.354190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe790e7-3765-4759-9108-4ce3101e56f9 could not be found. May 27 15:27:15.354190 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:15.356032 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-5e5da191-cfd3-414a-b50c-160e239a2af1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Returning 404 to user: Instance afe790e7-3765-4759-9108-4ce3101e56f9 could not be found. {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:27:15.356032 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-5e5da191-cfd3-414a-b50c-160e239a2af1 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "DELETE /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9" status: 404 len: 111 microversion: 2.1 time: 0.030578 May 27 15:27:15.356032 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 551/1121] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:27:15 2022] DELETE /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:27:15.360405 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e0a4b043-2425-4640-8210-9d7fbebc6ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:15.361033 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-e0a4b043-2425-4640-8210-9d7fbebc6ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: afe790e7-3765-4759-9108-4ce3101e56f9] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:15.367884 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e0a4b043-2425-4640-8210-9d7fbebc6ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:15.368337 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e0a4b043-2425-4640-8210-9d7fbebc6ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:15.369144 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e0a4b043-2425-4640-8210-9d7fbebc6ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:15.369621 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-e0a4b043-2425-4640-8210-9d7fbebc6ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:15.384399 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-e0a4b043-2425-4640-8210-9d7fbebc6ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] HTTP exception thrown: Instance afe790e7-3765-4759-9108-4ce3101e56f9 could not be found. May 27 15:27:15.386051 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e0a4b043-2425-4640-8210-9d7fbebc6ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Request method failure captured: May 27 15:27:15.386051 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9 HTTP/1.1 May 27 15:27:15.386051 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:27:15.386051 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:27:15.386051 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:27:15.386051 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:27:15.386051 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:27:15.386051 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:27:15.386051 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:27:15.386051 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:27:15.386051 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOzNSb8dAVARh41NDH1neBeIQ7mEiYGzluZ1aLHWr-bZMM8Yk3DEMls-W331t4g56BKuQBAiw5JIF3Yut9sBSPvmBYrZo49s8qFM14ylIEBI_1nGqB4zBnvHBSyTSPec4EhH5fjot66Y9DnhxIGyrqIMzSWHLKve581Z3mM8_f45p1g May 27 15:27:15.386051 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:27:15.386051 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:27:15.386051 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:27:15.386051 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:27:15.386051 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:27:15.386051 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:27:15.386051 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:27:15.386051 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:15.386051 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:27:15.386051 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:27:15.387703 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f027c3b75bc6430abd765a26269f9058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:27:15.387703 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:15.387703 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:27:15.387703 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:15.387703 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:27:15.387703 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:27:15.387703 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:27:15.387703 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: b1302d3b8649407ca010f12aad7a6597 May 27 15:27:15.387703 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:27:15.387703 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:27:15.387703 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance afe790e7-3765-4759-9108-4ce3101e56f9 could not be found. May 27 15:27:15.387703 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': 'afe790e7-3765-4759-9108-4ce3101e56f9'} May 27 15:27:15.388626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:27:15.388626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:15.388626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:27:15.388626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:27:15.388626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:27:15.388626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:27:15.388626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:27:15.388626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:27:15.388626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:27:15.388626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:27:15.388626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe790e7-3765-4759-9108-4ce3101e56f9 could not be found. May 27 15:27:15.388626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:27:15.388626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:15.388626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:27:15.388626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:15.388626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:15.388626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:15.388626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:27:15.388626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:27:15.388626 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:27:15.390175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:27:15.390175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:27:15.390175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:27:15.390175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:27:15.390175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:27:15.390175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:27:15.390175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:27:15.390175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe790e7-3765-4759-9108-4ce3101e56f9 could not be found. May 27 15:27:15.390175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:27:15.390175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:15.390175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:27:15.390175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:15.390175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:15.390175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:15.390175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:27:15.390175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:27:15.390175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe790e7-3765-4759-9108-4ce3101e56f9 could not be found. May 27 15:27:15.390175 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:27:15.391586 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-e0a4b043-2425-4640-8210-9d7fbebc6ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Returning 404 to user: Instance afe790e7-3765-4759-9108-4ce3101e56f9 could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:27:15.391586 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-e0a4b043-2425-4640-8210-9d7fbebc6ab2 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9" status: 404 len: 111 microversion: 2.1 time: 0.031694 May 27 15:27:15.391586 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 571/1122] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:27:15 2022] GET /compute/v2.1/servers/afe790e7-3765-4759-9108-4ce3101e56f9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 15:27:15.396706 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d9a2d41b-95be-4646-9c98-054546a59dcc tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:15.397231 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-d9a2d41b-95be-4646-9c98-054546a59dcc tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: df6c7382-2e3c-43bd-b678-327aea25a957] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:15.403220 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d9a2d41b-95be-4646-9c98-054546a59dcc tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:15.403662 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d9a2d41b-95be-4646-9c98-054546a59dcc tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:15.404413 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d9a2d41b-95be-4646-9c98-054546a59dcc tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:15.404844 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-d9a2d41b-95be-4646-9c98-054546a59dcc tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:15.419410 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-d9a2d41b-95be-4646-9c98-054546a59dcc tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] HTTP exception thrown: Instance df6c7382-2e3c-43bd-b678-327aea25a957 could not be found. May 27 15:27:15.421624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d9a2d41b-95be-4646-9c98-054546a59dcc tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Request method failure captured: May 27 15:27:15.421624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: DELETE /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957 HTTP/1.1 May 27 15:27:15.421624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:27:15.421624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:27:15.421624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:27:15.421624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 0 May 27 15:27:15.421624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:27:15.421624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:27:15.421624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:27:15.421624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:27:15.421624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOzNSb8dAVARh41NDH1neBeIQ7mEiYGzluZ1aLHWr-bZMM8Yk3DEMls-W331t4g56BKuQBAiw5JIF3Yut9sBSPvmBYrZo49s8qFM14ylIEBI_1nGqB4zBnvHBSyTSPec4EhH5fjot66Y9DnhxIGyrqIMzSWHLKve581Z3mM8_f45p1g May 27 15:27:15.421624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:27:15.421624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:27:15.421624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:27:15.421624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:27:15.421624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:27:15.421624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:27:15.421624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:27:15.421624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:15.421624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:27:15.421624 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:27:15.423280 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f027c3b75bc6430abd765a26269f9058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:27:15.423280 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:15.423280 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:27:15.423280 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:15.423280 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:27:15.423280 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:27:15.423280 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:27:15.423280 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: b1302d3b8649407ca010f12aad7a6597 May 27 15:27:15.423280 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:27:15.423280 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: > May 27 15:27:15.423280 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Instance df6c7382-2e3c-43bd-b678-327aea25a957 could not be found. May 27 15:27:15.423280 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'id': 'df6c7382-2e3c-43bd-b678-327aea25a957'} May 27 15:27:15.424188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:27:15.424188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:15.424188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:27:15.424188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:27:15.424188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:27:15.424188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:27:15.424188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:27:15.424188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:27:15.424188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:27:15.424188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:27:15.424188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df6c7382-2e3c-43bd-b678-327aea25a957 could not be found. May 27 15:27:15.424188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:15.424188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:15.424188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:15.424188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:15.424188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:15.424188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:15.424188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:27:15.424188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:27:15.424188 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:27:15.425698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:27:15.425698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:27:15.425698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:27:15.425698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:27:15.425698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:27:15.425698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:27:15.425698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:27:15.425698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:27:15.425698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:27:15.425698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df6c7382-2e3c-43bd-b678-327aea25a957 could not be found. May 27 15:27:15.425698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:15.425698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:15.425698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:15.425698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:15.425698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:15.425698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:15.425698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:27:15.425698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:27:15.425698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df6c7382-2e3c-43bd-b678-327aea25a957 could not be found. May 27 15:27:15.425698 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:15.427220 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-d9a2d41b-95be-4646-9c98-054546a59dcc tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Returning 404 to user: Instance df6c7382-2e3c-43bd-b678-327aea25a957 could not be found. {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:27:15.427220 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-d9a2d41b-95be-4646-9c98-054546a59dcc tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "DELETE /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957" status: 404 len: 111 microversion: 2.1 time: 0.030095 May 27 15:27:15.427220 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 552/1123] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:27:15 2022] DELETE /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:27:15.431468 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-234764ac-2839-44a7-952e-ec442f587341 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:15.432084 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-234764ac-2839-44a7-952e-ec442f587341 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: df6c7382-2e3c-43bd-b678-327aea25a957] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:15.438724 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-234764ac-2839-44a7-952e-ec442f587341 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:15.439196 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-234764ac-2839-44a7-952e-ec442f587341 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:15.440022 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-234764ac-2839-44a7-952e-ec442f587341 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:15.440393 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-234764ac-2839-44a7-952e-ec442f587341 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:15.453833 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-234764ac-2839-44a7-952e-ec442f587341 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] HTTP exception thrown: Instance df6c7382-2e3c-43bd-b678-327aea25a957 could not be found. May 27 15:27:15.455375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-234764ac-2839-44a7-952e-ec442f587341 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Request method failure captured: May 27 15:27:15.455375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957 HTTP/1.1 May 27 15:27:15.455375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:27:15.455375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:27:15.455375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:27:15.455375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:27:15.455375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:27:15.455375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:27:15.455375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:27:15.455375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:27:15.455375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOzNSb8dAVARh41NDH1neBeIQ7mEiYGzluZ1aLHWr-bZMM8Yk3DEMls-W331t4g56BKuQBAiw5JIF3Yut9sBSPvmBYrZo49s8qFM14ylIEBI_1nGqB4zBnvHBSyTSPec4EhH5fjot66Y9DnhxIGyrqIMzSWHLKve581Z3mM8_f45p1g May 27 15:27:15.455375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:27:15.455375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:27:15.455375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:27:15.455375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:27:15.455375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:27:15.455375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:27:15.455375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:27:15.455375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:15.455375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:27:15.455375 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:27:15.457000 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f027c3b75bc6430abd765a26269f9058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:27:15.457000 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:15.457000 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:27:15.457000 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:15.457000 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:27:15.457000 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:27:15.457000 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:27:15.457000 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: b1302d3b8649407ca010f12aad7a6597 May 27 15:27:15.457000 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:27:15.457000 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:27:15.457000 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance df6c7382-2e3c-43bd-b678-327aea25a957 could not be found. May 27 15:27:15.457000 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': 'df6c7382-2e3c-43bd-b678-327aea25a957'} May 27 15:27:15.457915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:27:15.457915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:15.457915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:27:15.457915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:27:15.457915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:27:15.457915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:27:15.457915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:27:15.457915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:27:15.457915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:27:15.457915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:27:15.457915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df6c7382-2e3c-43bd-b678-327aea25a957 could not be found. May 27 15:27:15.457915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:27:15.457915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:15.457915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:27:15.457915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:15.457915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:15.457915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:15.457915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:27:15.457915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:27:15.457915 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:27:15.459490 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:27:15.459490 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:27:15.459490 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:27:15.459490 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:27:15.459490 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:27:15.459490 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:27:15.459490 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:27:15.459490 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df6c7382-2e3c-43bd-b678-327aea25a957 could not be found. May 27 15:27:15.459490 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:27:15.459490 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:15.459490 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:27:15.459490 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:15.459490 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:15.459490 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:15.459490 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:27:15.459490 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:27:15.459490 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df6c7382-2e3c-43bd-b678-327aea25a957 could not be found. May 27 15:27:15.459490 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:27:15.460984 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-234764ac-2839-44a7-952e-ec442f587341 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Returning 404 to user: Instance df6c7382-2e3c-43bd-b678-327aea25a957 could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:27:15.460984 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-234764ac-2839-44a7-952e-ec442f587341 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957" status: 404 len: 111 microversion: 2.1 time: 0.029214 May 27 15:27:15.460984 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 572/1124] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:27:15 2022] GET /compute/v2.1/servers/df6c7382-2e3c-43bd-b678-327aea25a957 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:27:16.591375 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9f2a914e-9a75-462d-9aaa-5da8c4f8bb44 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:16.592360 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.compute.api [None req-9f2a914e-9a75-462d-9aaa-5da8c4f8bb44 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117743) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:16.599170 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9f2a914e-9a75-462d-9aaa-5da8c4f8bb44 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:16.599626 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9f2a914e-9a75-462d-9aaa-5da8c4f8bb44 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:16.600399 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9f2a914e-9a75-462d-9aaa-5da8c4f8bb44 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:16.600838 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG oslo_concurrency.lockutils [None req-9f2a914e-9a75-462d-9aaa-5da8c4f8bb44 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117743) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:16.615062 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.wsgi [None req-9f2a914e-9a75-462d-9aaa-5da8c4f8bb44 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] HTTP exception thrown: Instance 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e could not be found. May 27 15:27:16.616588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9f2a914e-9a75-462d-9aaa-5da8c4f8bb44 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Request method failure captured: May 27 15:27:16.616588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: request: DELETE /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e HTTP/1.1 May 27 15:27:16.616588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept: application/json May 27 15:27:16.616588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Accept-Encoding: identity May 27 15:27:16.616588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Connection: close May 27 15:27:16.616588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Length: 0 May 27 15:27:16.616588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Content-Type: application/json May 27 15:27:16.616588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Host: 10.222.0.50 May 27 15:27:16.616588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Openstack-System-Scope: None May 27 15:27:16.616588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: User-Agent: python-urllib3/1.26.9 May 27 15:27:16.616588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Auth-Token: gAAAAABikOzNSb8dAVARh41NDH1neBeIQ7mEiYGzluZ1aLHWr-bZMM8Yk3DEMls-W331t4g56BKuQBAiw5JIF3Yut9sBSPvmBYrZo49s8qFM14ylIEBI_1nGqB4zBnvHBSyTSPec4EhH5fjot66Y9DnhxIGyrqIMzSWHLKve581Z3mM8_f45p1g May 27 15:27:16.616588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Id: None May 27 15:27:16.616588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Domain-Name: None May 27 15:27:16.616588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Identity-Status: Confirmed May 27 15:27:16.616588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Is-Admin-Project: True May 27 15:27:16.616588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Id: default May 27 15:27:16.616588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Domain-Name: Default May 27 15:27:16.616588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:27:16.616588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:16.616588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Role: reader,member May 27 15:27:16.616588 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Roles: reader,member May 27 15:27:16.618251 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f027c3b75bc6430abd765a26269f9058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:27:16.618251 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:16.618251 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:27:16.618251 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:16.618251 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:27:16.618251 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Id: default May 27 15:27:16.618251 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Domain-Name: Default May 27 15:27:16.618251 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Id: b1302d3b8649407ca010f12aad7a6597 May 27 15:27:16.618251 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: X-User-Name: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:27:16.618251 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: method: > May 27 15:27:16.618251 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: exception: Instance 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e could not be found. May 27 15:27:16.618251 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: action_args: {'id': '8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e'} May 27 15:27:16.619119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: {{(pid=117743) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:27:16.619119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:16.619119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:27:16.619119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:27:16.619119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:27:16.619119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:27:16.619119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:27:16.619119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:27:16.619119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:27:16.619119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:27:16.619119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e could not be found. May 27 15:27:16.619119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:16.619119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:16.619119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:16.619119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:16.619119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:16.619119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:16.619119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:27:16.619119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:27:16.619119 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:27:16.620392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:27:16.620392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 15:27:16.620392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 15:27:16.620392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 15:27:16.620392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 15:27:16.620392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:27:16.620392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:27:16.620392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:27:16.620392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:27:16.620392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e could not be found. May 27 15:27:16.620392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:16.620392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:16.620392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:16.620392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:16.620392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:16.620392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:16.620392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:27:16.620392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:27:16.620392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e could not be found. May 27 15:27:16.620392 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: ERROR nova.api.openstack.wsgi May 27 15:27:16.621684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: DEBUG nova.api.openstack.wsgi [None req-9f2a914e-9a75-462d-9aaa-5da8c4f8bb44 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Returning 404 to user: Instance 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e could not be found. {{(pid=117743) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:27:16.621684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO nova.api.openstack.requestlog [None req-9f2a914e-9a75-462d-9aaa-5da8c4f8bb44 tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e" status: 404 len: 111 microversion: 2.1 time: 0.030463 May 27 15:27:16.621684 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: [pid: 117743|app: 0|req: 553/1125] 10.222.0.50 () {58 vars in 1238 bytes} [Fri May 27 15:27:16 2022] DELETE /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:27:16.626418 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-c85d1c6e-6c37-4246-9a0f-25508924374e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Calling method '>' {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 15:27:16.627066 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.compute.api [None req-c85d1c6e-6c37-4246-9a0f-25508924374e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] [instance: 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e] Fetching instance by UUID {{(pid=117742) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 15:27:16.633601 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c85d1c6e-6c37-4246-9a0f-25508924374e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:16.634054 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c85d1c6e-6c37-4246-9a0f-25508924374e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:16.634819 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c85d1c6e-6c37-4246-9a0f-25508924374e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 15:27:16.635296 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG oslo_concurrency.lockutils [None req-c85d1c6e-6c37-4246-9a0f-25508924374e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Lock "73a26acb-fd81-476d-b23a-413b6c7fb5a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117742) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 15:27:16.648761 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.wsgi [None req-c85d1c6e-6c37-4246-9a0f-25508924374e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] HTTP exception thrown: Instance 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e could not be found. May 27 15:27:16.650264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-c85d1c6e-6c37-4246-9a0f-25508924374e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Request method failure captured: May 27 15:27:16.650264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: request: GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e HTTP/1.1 May 27 15:27:16.650264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept: application/json May 27 15:27:16.650264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Accept-Encoding: identity May 27 15:27:16.650264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Connection: close May 27 15:27:16.650264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Length: 0 May 27 15:27:16.650264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Content-Type: application/json May 27 15:27:16.650264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Host: 10.222.0.50 May 27 15:27:16.650264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Openstack-System-Scope: None May 27 15:27:16.650264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: User-Agent: python-urllib3/1.26.9 May 27 15:27:16.650264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Auth-Token: gAAAAABikOzNSb8dAVARh41NDH1neBeIQ7mEiYGzluZ1aLHWr-bZMM8Yk3DEMls-W331t4g56BKuQBAiw5JIF3Yut9sBSPvmBYrZo49s8qFM14ylIEBI_1nGqB4zBnvHBSyTSPec4EhH5fjot66Y9DnhxIGyrqIMzSWHLKve581Z3mM8_f45p1g May 27 15:27:16.650264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Id: None May 27 15:27:16.650264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Domain-Name: None May 27 15:27:16.650264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Identity-Status: Confirmed May 27 15:27:16.650264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Is-Admin-Project: True May 27 15:27:16.650264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Id: default May 27 15:27:16.650264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Domain-Name: Default May 27 15:27:16.650264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:27:16.650264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:16.650264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Role: reader,member May 27 15:27:16.650264 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Roles: reader,member May 27 15:27:16.651926 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f027c3b75bc6430abd765a26269f9058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f027c3b75bc6430abd765a26269f9058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/"}]}] May 27 15:27:16.651926 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:16.651926 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Id: f027c3b75bc6430abd765a26269f9058 May 27 15:27:16.651926 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274491233 May 27 15:27:16.651926 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:27:16.651926 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Id: default May 27 15:27:16.651926 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Domain-Name: Default May 27 15:27:16.651926 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Id: b1302d3b8649407ca010f12aad7a6597 May 27 15:27:16.651926 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: X-User-Name: tempest-AttachVolumeNegativeTest-1274491233-project May 27 15:27:16.651926 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: method: > May 27 15:27:16.651926 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: exception: Instance 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e could not be found. May 27 15:27:16.651926 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: action_args: {'id': '8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e'} May 27 15:27:16.652745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: {{(pid=117742) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 15:27:16.652745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:16.652745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 15:27:16.652745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 15:27:16.652745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 15:27:16.652745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 15:27:16.652745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 15:27:16.652745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 15:27:16.652745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 15:27:16.652745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 15:27:16.652745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e could not be found. May 27 15:27:16.652745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:27:16.652745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:16.652745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:27:16.652745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:16.652745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:16.652745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:16.652745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 15:27:16.652745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 15:27:16.652745 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 15:27:16.653998 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 15:27:16.653998 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 15:27:16.653998 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 15:27:16.653998 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 15:27:16.653998 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 15:27:16.653998 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 15:27:16.653998 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 15:27:16.653998 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e could not be found. May 27 15:27:16.653998 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:27:16.653998 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 15:27:16.653998 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:27:16.653998 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 15:27:16.653998 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 15:27:16.653998 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 15:27:16.653998 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 15:27:16.653998 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 15:27:16.653998 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e could not be found. May 27 15:27:16.653998 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: ERROR nova.api.openstack.wsgi May 27 15:27:16.655788 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: DEBUG nova.api.openstack.wsgi [None req-c85d1c6e-6c37-4246-9a0f-25508924374e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] Returning 404 to user: Instance 8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e could not be found. {{(pid=117742) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 15:27:16.655788 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO nova.api.openstack.requestlog [None req-c85d1c6e-6c37-4246-9a0f-25508924374e tempest-AttachVolumeNegativeTest-1274491233 tempest-AttachVolumeNegativeTest-1274491233-project] 10.222.0.50 "GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e" status: 404 len: 111 microversion: 2.1 time: 0.029150 May 27 15:27:16.655788 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: [pid: 117742|app: 0|req: 573/1126] 10.222.0.50 () {58 vars in 1235 bytes} [Fri May 27 15:27:16 2022] GET /compute/v2.1/servers/8ee1dd2e-4cbd-4b77-8d8e-c4d1c0660c3e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 15:27:27.842720 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:27:27.843541 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Fri May 27 15:27:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:29:58.597872 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:29:58.598465 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Fri May 27 15:29:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:29:59.262081 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:29:59.262622 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Fri May 27 15:29:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:30:16.148200 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:30:16.148801 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Fri May 27 15:30:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:30:47.852671 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:30:47.853473 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Fri May 27 15:30:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:31:14.503018 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:31:14.503616 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Fri May 27 15:31:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:31:25.279103 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:31:25.280128 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Fri May 27 15:31:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:33:18.606297 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:33:18.606994 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Fri May 27 15:33:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:33:19.270508 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:33:19.271081 dv-cinder-842542-2-iscsi devstack@n-api.service[117743]: Fri May 27 15:33:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 15:33:36.158172 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 15:33:36.158633 dv-cinder-842542-2-iscsi devstack@n-api.service[117742]: Fri May 27 15:33:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!